Sep 03 07:47:51 devstack cinder-volume[74626]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 03 07:47:51 devstack cinder-volume[74626]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 03 07:47:51 devstack cinder-volume[74626]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 03 07:47:52 devstack cinder-volume[74626]: INFO dbcounter [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Registered counter for database cinder
Sep 03 07:47:52 devstack cinder-volume[74626]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74626) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:47:53 devstack cinder-volume[74626]: DEBUG dbcounter [-] [74626] Writer thread running {{(pid=74626) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 03 07:47:53 devstack cinder-volume[74626]: INFO cinder.rpc [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 03 07:47:53 devstack cinder-volume[74626]: INFO cinder.rpc [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 03 07:47:53 devstack cinder-volume[74626]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74626) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:47:53 devstack cinder-volume[74626]: INFO cinder.volume.manager [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Determined volume DB was empty at startup.
Sep 03 07:47:53 devstack cinder-volume[74626]: DEBUG cinder.volume.manager [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74626) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 03 07:47:53 devstack cinder-volume[74626]: INFO cinder.volume.manager [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 03 07:47:53 devstack cinder-volume[74626]: WARNING stevedore.named [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 03 07:47:53 devstack cinder-volume[74626]: WARNING castellan.key_manager [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 03 07:47:53 devstack cinder-volume[74626]: WARNING cinder.keymgr.conf_key_mgr [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 03 07:47:53 devstack cinder-volume[74626]: DEBUG cinder.volume.drivers.lvm [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74626) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 03 07:47:53 devstack cinder-volume[74626]: DEBUG oslo_concurrency.processutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:47:54 devstack cinder-volume[74626]: DEBUG oslo_concurrency.processutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] CMD "cinder-rtstool verify" returned: 0 in 1.016s {{(pid=74626) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:47:54 devstack cinder-volume[74626]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74626) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:47:54 devstack cinder-volume[74626]: INFO cinder.rpc [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 03 07:47:54 devstack cinder-volume[74626]: INFO cinder.rpc [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 03 07:47:54 devstack cinder-volume[74626]: WARNING stevedore.named [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 03 07:47:54 devstack cinder-volume[74626]: WARNING castellan.key_manager [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 03 07:47:54 devstack cinder-volume[74626]: INFO cinder.volume.manager [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 03 07:47:54 devstack cinder-volume[74626]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74626) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:47:55 devstack cinder-volume[74626]: INFO oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Starting 1 workers
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Started child 74757 {{(pid=74626) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Full set of CONF: {{(pid=74626) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] ******************************************************************************** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Configuration options gathered from: {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] ================================================================================ {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] allow_availability_zone_fallback = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] allow_compression_on_image_upload = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] allowed_direct_url_schemes     = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] api_rate_limit                 = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] auth_strategy                  = keystone {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] az_cache_duration              = 3600 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_availability_zone      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_host                   = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_name                   = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_stats_polling_interval = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backup_api_class               = cinder.backup.api.API {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74757]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backup_name_template           = backup-%s {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backup_use_same_host           = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backup_use_temp_snapshot       = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] chap_password                  = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] chap_username                  =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_internal_tenant_project_id = 388e0d0646f04593b3f71f9c58cecaf2 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_internal_tenant_user_id = 8e8681dba38f43e68188abd00808d4e8 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cloned_volume_same_az          = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cluster                        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] compression_format             = gzip {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] compute_api_class              = cinder.compute.nova.API {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] config_dir                     = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] config_source                  = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] control_exchange               = openstack {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] debug                          = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] default_availability_zone      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] default_group_type             = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] default_volume_type            = lvmdriver-1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] driver_client_cert             = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] driver_client_cert_key         = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] driver_data_namespace          = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] driver_ssl_cert_path           = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] driver_ssl_cert_verify         = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] driver_use_ssl                 = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] enable_force_upload            = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] enable_new_services            = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] enable_unsupported_driver      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] enforce_multipath_for_image_xfer = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] filter_function                = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_api_insecure            = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_api_ssl_compression     = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_ca_certificates_file    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_catalog_info            = image:glance:publicURL {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_certfile                = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_keyfile                 = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_num_retries             = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] glance_request_timeout         = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] goodness_function              = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] graceful_shutdown_timeout      = 5 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] group_api_class                = cinder.group.api.API {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] host                           = devstack {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_compress_on_upload       = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_conversion_address_space_limit = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_conversion_cpu_limit     = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_conversion_disable       = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_upload_use_cinder_backend = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_upload_use_internal_tenant = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_volume_cache_enabled     = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_volume_cache_max_count   = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] image_volume_cache_max_size_gb = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] init_host_max_objects_retrieval = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] instance_format                = [instance: %(uuid)s]  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] iscsi_iotype                   = fileio {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] iscsi_target_flags             =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] iscsi_write_cache              = on {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] iser_helper                    = tgtadm {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] iser_ip_address                = 192.168.122.151 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] iser_port                      = 3260 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_color                      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_config_append              = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_dir                        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_file                       = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_options                    = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_rotate_interval            = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_rotate_interval_type       = days {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] log_rotation_type              = none {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] max_age                        = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] max_logfile_count              = 30 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] max_logfile_size_mb            = 200 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] max_over_subscription_ratio    = 20.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] message_reap_interval          = 86400 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] message_ttl                    = 2592000 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] migration_create_volume_timeout_secs = 300 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] monkey_patch                   = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] monkey_patch_modules           = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] my_ip                          = 192.168.122.151 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] no_snapshot_gb_quota           = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] num_iser_scan_tries            = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] num_shell_tries                = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] num_volume_device_scan_tries   = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] nvmeof_conn_info_version       = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] nvmet_ns_id                    = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] nvmet_port_id                  = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] osapi_max_limit                = 1000 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] osapi_volume_ext_list          = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] osapi_volume_listen_port       = 8776 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] osapi_volume_use_ssl           = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] osapi_volume_workers           = 2 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] per_volume_size_limit          = -1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] periodic_fuzzy_delay           = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] periodic_interval              = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] public_endpoint                = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] publish_errors                 = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] quota_backup_gigabytes         = 1000 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] quota_backups                  = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] quota_gigabytes                = 1000 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] quota_groups                   = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] quota_snapshots                = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] quota_volumes                  = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] rate_limit_burst               = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] rate_limit_except_level        = CRITICAL {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] rate_limit_interval            = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] reinit_driver_count            = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] replication_device             = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] report_discard_supported       = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] report_interval                = 120 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] reservation_clean_interval     = 86400 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] reservation_expire             = 86400 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] reserved_image_namespaces      = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] reserved_percentage            = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] rpc_response_timeout           = 120 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] run_external_periodic_tasks    = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] scst_target_driver             = iscsi {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] scst_target_iqn_name           = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_down_time              = 720 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] shell_completion               = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] snapshot_name_template         = snapshot-%s {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] snapshot_same_host             = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] split_loggers                  = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] state_path                     = /opt/stack/data/cinder {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] storage_availability_zone      = nova {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] storage_protocol               = iSCSI {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] syslog_log_facility            = LOG_USER {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] target_helper                  = lioadm {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] target_ip_address              = 192.168.122.151 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] target_port                    = 3260 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] target_protocol                = iscsi {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] target_secondary_ip_addresses  = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] trace_flags                    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] transport_url                  = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] until_refresh                  = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] use_chap_auth                  = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] use_default_quota_class        = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] use_journal                    = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] use_json                       = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] use_multipath_for_image_xfer   = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] use_stderr                     = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] use_syslog                     = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] verify_glance_signatures       = enabled {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_api_class               = cinder.volume.api.API {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_backend_name            = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_clear                   = zero {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_clear_ionice            = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_clear_size              = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_copy_bps_limit          = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_dd_blocksize            = 1M {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_name_template           = volume-%s {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_service_inithost_offload = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volume_usage_audit_period      = month {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] watch_log_file                 = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] zoning_mode                    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_concurrency.disable_process_locking = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.admin_password = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.admin_token = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.admin_user  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_port   = 35357 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_protocol = https {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_section = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_type   = password {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_uri    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.auth_version = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.cache       = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.certfile    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.delay_auth_decision = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.http_connect_timeout = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.identity_uri = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.include_service_catalog = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.insecure    = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.interface   = public {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.keyfile     = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_password =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcache_username =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.region_name = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.service_token_roles_required = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.service_type = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.token_cache_time = 300 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] keystone_authtoken.www_authenticate_uri = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.backend                  = dogpile.cache.null {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.backend_argument         = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.backend_expiration_time  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.config_prefix            = cache.oslo {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.dead_timeout             = 60.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.debug_cache_backend      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.enable_retry_client      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.enable_socket_keepalive  = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.enabled                  = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.enforce_fips_mode        = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.expiration_time          = 600 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.hashclient_retry_attempts = 2 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_dead_retry      = 300 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_password        = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_pool_maxsize    = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_sasl_enabled    = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.memcache_username        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.proxies                  = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.redis_db                 = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.redis_password           = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.redis_sentinel_service_name = mymaster {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.redis_server             = localhost:6379 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.redis_socket_timeout     = 1.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.redis_username           = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.retry_attempts           = 2 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.retry_delay              = 0.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.socket_keepalive_count   = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.socket_keepalive_idle    = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.socket_keepalive_interval = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.tls_allowed_ciphers      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.tls_cafile               = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.tls_certfile             = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.tls_enabled              = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cache.tls_keyfile              = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] coordination.backend_url       = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.asyncio_connection    = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.asyncio_slave_connection = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.backend               = sqlalchemy {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.connection            = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.connection_debug      = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.connection_parameters =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74757]: INFO cinder.volume.manager [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.connection_recycle_time = 3600 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.connection_trace      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.db_inc_retry_interval = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.db_max_retries        = 20 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.db_max_retry_interval = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.db_retry_interval     = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.max_overflow          = 50 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.max_pool_size         = 5 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.max_retries           = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.mysql_wsrep_sync_wait = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.pool_timeout          = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.retry_interval        = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.slave_connection      = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.sqlite_synchronous    = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] database.use_db_reconnect      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.connection_string     = messaging:// {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.enabled               = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.es_doc_type           = notification {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.es_scroll_size        = 10000 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.es_scroll_time        = 2m {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.filter_error_trace    = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.hmac_keys             = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.sentinel_service_name = mymaster {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.socket_timeout        = 0.1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.trace_requests        = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler.trace_sqlalchemy      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler_jaeger.process_tags   = {} {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler_jaeger.service_name_prefix = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] profiler_otlp.service_name_prefix = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.enforce_new_defaults = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: WARNING oslo_config.cfg [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.enforce_scope      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.policy_default_rule = default {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.policy_file        = policy.yaml {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] privsep_osbrick.group          = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] privsep_osbrick.helper_command = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] privsep_osbrick.thread_pool_size = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] privsep_osbrick.user           = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_sys_admin.group         = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_sys_admin.helper_command = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] cinder_sys_admin.user          = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.auth_section      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.auth_type         = password {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.certfile          = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.collect_timing    = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.insecure          = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.keyfile           = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.send_service_user_token = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.split_loggers     = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] service_user.timeout           = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.backend_availability_zone = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.chap_password = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.chap_username =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.driver_client_cert = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.driver_client_cert_key = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.driver_data_namespace = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.driver_use_ssl = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.enable_unsupported_driver = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.extra_capabilities = {} {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.filter_function = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.goodness_function = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.iscsi_iotype  = fileio {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.iscsi_target_flags =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.iscsi_write_cache = on {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.iser_helper   = tgtadm {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.iser_port     = 3260 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.lvm_share_target = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.lvm_type      = auto {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.num_shell_tries = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.nvmet_port_id = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.replication_device = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.report_discard_supported = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.reserved_percentage = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.scst_target_driver = iscsi {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.scst_target_iqn_name = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.storage_protocol = iSCSI {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.target_helper = tgtadm {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.target_port   = 3260 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.target_protocol = iscsi {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.trace_flags   = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.unique_fqdn_network = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.use_chap_auth = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_backend_name = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_clear  = zero {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_clear_ionice = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_clear_size = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_reports.file_event_handler = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_reports.log_dir           = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.backend_availability_zone = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.backend_host       = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.chap_password      = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.chap_username      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.driver_client_cert = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.driver_data_namespace = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:55 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.extra_capabilities = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.filter_function    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.goodness_function  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.iscsi_iotype       = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.263s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.iser_helper        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.iser_ip_address    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.iser_port          = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.iser_target_prefix = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.lvm_share_target   = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.lvm_type           = auto {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.num_shell_tries    = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.replication_device = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.report_discard_supported = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.reserved_percentage = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.scst_target_driver = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.storage_protocol   = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.target_helper      = lioadm {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.target_ip_address  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.target_port        = 3260 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.trace_flags        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.use_chap_auth      = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_clear       = zero {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_clear_size  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] lvmdriver-1.volumes_dir        = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.ssl      = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_notifications.driver = [] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_notifications.retry = -1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] oslo_messaging_notifications.transport_url = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] key_manager.fixed_key          = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.barbican_api_version  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.barbican_endpoint     = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.barbican_endpoint_type = public {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.barbican_region_name  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.cafile                = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.certfile              = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.collect_timing        = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.insecure              = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.keyfile               = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.number_of_retries     = 60 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.retry_delay           = 1 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.send_service_user_token = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.split_loggers         = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.timeout               = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.verify_ssl            = True {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican.verify_ssl_path       = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.auth_section = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.auth_type = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.cafile   = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.certfile = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.collect_timing = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.insecure = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.keyfile  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.split_loggers = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] barbican_service_user.timeout  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.approle_role_id          = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.approle_secret_id        = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.kv_mountpoint            = secret {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.kv_path                  = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.kv_version               = 2 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.namespace                = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.root_token_id            = **** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.ssl_ca_crt_file          = None {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.timeout                  = 60.0 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.use_ssl                  = False {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:47:56 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] ******************************************************************************** {{(pid=74626) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 03 07:47:56 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.197s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:47:56 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:47:56 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.159s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:47:56 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:47:56 devstack sudo[74854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 03 07:47:56 devstack sudo[74854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:47:58 devstack sudo[74854]: pam_unix(sudo:session): session closed for user root
Sep 03 07:47:58 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.147s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:47:58 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:47:58 devstack sudo[74977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:47:58 devstack sudo[74977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:00 devstack sudo[74977]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:00 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.898s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:00 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 07:48:00 devstack cinder-volume[74757]: INFO cinder.brick.local_dev.lvm [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 03 07:48:00 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:00 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.095s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:00 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:00 devstack sudo[75080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:48:00 devstack sudo[75080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:02 devstack sudo[75080]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:02 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.920s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:02 devstack cinder-volume[74757]: DEBUG cinder.brick.local_dev.lvm [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74757) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 03 07:48:02 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:02 devstack sudo[75173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:02 devstack sudo[75173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:05 devstack cinder-volume[74626]: DEBUG dbcounter [-] [74626] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74626) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:48:06 devstack sudo[75173]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:06 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.429s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:06 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:06 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.116s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:06 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:06 devstack sudo[75374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:06 devstack sudo[75374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:08 devstack sudo[75374]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:08 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.064s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:08 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:08 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.132s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:08 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:08 devstack sudo[75412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 03 07:48:08 devstack sudo[75412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:10 devstack sudo[75412]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:10 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.310s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:10 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:11 devstack sudo[75441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:48:11 devstack sudo[75441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:13 devstack sudo[75441]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:13 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.825s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:13 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:13 devstack sudo[75503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:48:13 devstack sudo[75503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:16 devstack sudo[75503]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:16 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.735s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:16 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:16 devstack sudo[75510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:48:16 devstack sudo[75510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:19 devstack sudo[75510]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:19 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.800s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:19 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:19 devstack sudo[75515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:19 devstack sudo[75515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:21 devstack sudo[75515]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:21 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.083s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:21 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:21 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.127s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:21 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:21 devstack sudo[75520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:21 devstack sudo[75520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:23 devstack sudo[75520]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:23 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.299s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:23 devstack cinder-volume[74757]: INFO cinder.volume.drivers.lvm [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 03 07:48:23 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:24 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:24 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:24 devstack sudo[75618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:24 devstack sudo[75618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:26 devstack sudo[75618]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:26 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.147s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:26 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:48:26 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:26 devstack sudo[75698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:48:26 devstack sudo[75698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:28 devstack sudo[75698]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:28 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.108s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:28 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:28 devstack sudo[75783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:48:28 devstack sudo[75783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:30 devstack sudo[75783]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:30 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.212s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:30 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:30 devstack sudo[75786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:30 devstack sudo[75786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:32 devstack sudo[75786]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:32 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.941s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:32 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:32 devstack sudo[75791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:48:32 devstack sudo[75791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:34 devstack sudo[75791]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.990s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:34 devstack cinder-volume[74757]: INFO cinder.volume.driver [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Driver hasn't implemented _init_vendor_properties()
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG cinder.volume.driver [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74757) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG oslo_db.sqlalchemy.engines [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74757) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG dbcounter [-] [74757] Writer thread running {{(pid=74757) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG cinder.db.sqlalchemy.api [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Building query based on filter {{(pid=74757) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG cinder.image.image_utils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74757) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 03 07:48:34 devstack cinder-volume[74757]: INFO cinder.keymgr.migration [None req-1b37ebe0-34f3-4da4-9afa-1bfc590eecf6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:48:34 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:35 devstack sudo[75797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:48:35 devstack sudo[75797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:37 devstack sudo[75797]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:37 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.056s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:37 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:37 devstack sudo[75856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:48:37 devstack sudo[75856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:39 devstack sudo[75856]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:39 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.968s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:39 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:39 devstack sudo[75950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:39 devstack sudo[75950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:41 devstack sudo[75950]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:41 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.756s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:41 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:41 devstack sudo[75953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:48:41 devstack sudo[75953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:43 devstack sudo[75953]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.155s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:44 devstack cinder-volume[74757]: DEBUG cinder.manager [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Notifying Schedulers of capabilities ... {{(pid=74757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:48:44 devstack cinder-volume[74757]: INFO cinder.volume.manager [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Driver initialization completed successfully.
Sep 03 07:48:44 devstack cinder-volume[74757]: INFO cinder.manager [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Initiating service 2 cleanup
Sep 03 07:48:44 devstack cinder-volume[74757]: INFO cinder.manager [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Service 2 cleanup completed.
Sep 03 07:48:44 devstack cinder-volume[74757]: DEBUG cinder.service [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Creating RPC server for service cinder-volume {{(pid=74757) start /opt/stack/cinder/cinder/service.py:239}}
Sep 03 07:48:44 devstack cinder-volume[74757]: DEBUG cinder.service [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74757) start /opt/stack/cinder/cinder/service.py:245}}
Sep 03 07:48:44 devstack cinder-volume[74757]: INFO cinder.volume.manager [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 03 07:48:44 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:48:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:44 devstack sudo[75956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:48:44 devstack sudo[75956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:46 devstack sudo[75956]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:46 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.195s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:46 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:46 devstack sudo[75964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:48:46 devstack sudo[75964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:48 devstack sudo[75964]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:48 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.971s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:48 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:48 devstack sudo[75968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:48:48 devstack sudo[75968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:50 devstack sudo[75968]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:50 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.012s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:50 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:48:50 devstack sudo[75975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:48:50 devstack sudo[75975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:48:52 devstack sudo[75975]: pam_unix(sudo:session): session closed for user root
Sep 03 07:48:52 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.848s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:48:52 devstack cinder-volume[74757]: INFO cinder.volume.manager [None req-6358b4ea-6ad2-4b00-917c-e69e6090457d None None] Driver post RPC initialization completed successfully.
Sep 03 07:48:54 devstack cinder-volume[74757]: DEBUG dbcounter [-] [74757] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74757) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:49:02 devstack cinder-volume[74757]: DEBUG dbcounter [-] [74757] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=74757) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:49:42 devstack cinder-volume[74757]: DEBUG oslo_service.periodic_task [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74757) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:49:42 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:49:42 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:49:42 devstack sudo[76987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:49:42 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:49:44 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root
Sep 03 07:49:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.990s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:49:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:49:44 devstack sudo[77083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:49:44 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:49:47 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root
Sep 03 07:49:47 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.241s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:49:47 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:49:47 devstack sudo[77226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:49:47 devstack sudo[77226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:49:49 devstack sudo[77226]: pam_unix(sudo:session): session closed for user root
Sep 03 07:49:49 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.988s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:49:49 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:49:49 devstack sudo[77316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:49:49 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:49:51 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root
Sep 03 07:49:51 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.969s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:49:51 devstack cinder-volume[74757]: DEBUG cinder.manager [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Notifying Schedulers of capabilities ... {{(pid=74757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:50:42 devstack cinder-volume[74757]: DEBUG oslo_service.periodic_task [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74757) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:50:42 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:50:42 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:50:42 devstack sudo[77768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:50:42 devstack sudo[77768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:50:44 devstack sudo[77768]: pam_unix(sudo:session): session closed for user root
Sep 03 07:50:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.069s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:50:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:50:45 devstack sudo[77771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:50:45 devstack sudo[77771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:50:47 devstack sudo[77771]: pam_unix(sudo:session): session closed for user root
Sep 03 07:50:47 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.097s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:50:47 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:50:47 devstack sudo[77790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:50:47 devstack sudo[77790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:50:49 devstack sudo[77790]: pam_unix(sudo:session): session closed for user root
Sep 03 07:50:49 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.963s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:50:49 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:50:49 devstack sudo[77796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:50:49 devstack sudo[77796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:50:51 devstack sudo[77796]: pam_unix(sudo:session): session closed for user root
Sep 03 07:50:51 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.983s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:50:51 devstack cinder-volume[74757]: DEBUG cinder.manager [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Notifying Schedulers of capabilities ... {{(pid=74757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:51:02 devstack cinder-volume[74757]: DEBUG dbcounter [-] [74757] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74757) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:51:42 devstack cinder-volume[74757]: DEBUG oslo_service.periodic_task [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74757) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:51:42 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:51:42 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:51:42 devstack sudo[80496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:51:42 devstack sudo[80496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:51:44 devstack sudo[80496]: pam_unix(sudo:session): session closed for user root
Sep 03 07:51:45 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.172s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:51:45 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:51:45 devstack sudo[80658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:51:45 devstack sudo[80658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:51:47 devstack sudo[80658]: pam_unix(sudo:session): session closed for user root
Sep 03 07:51:47 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.100s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:51:47 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:51:47 devstack sudo[80808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:51:47 devstack sudo[80808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:51:49 devstack sudo[80808]: pam_unix(sudo:session): session closed for user root
Sep 03 07:51:49 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.914s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:51:49 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:51:49 devstack sudo[80858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:51:49 devstack sudo[80858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:51:50 devstack sudo[80858]: pam_unix(sudo:session): session closed for user root
Sep 03 07:51:50 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.835s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:51:50 devstack cinder-volume[74757]: DEBUG cinder.manager [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Notifying Schedulers of capabilities ... {{(pid=74757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:52:42 devstack cinder-volume[74757]: DEBUG oslo_service.periodic_task [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74757) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:52:42 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:52:42 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:52:42 devstack sudo[81036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:52:42 devstack sudo[81036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:52:44 devstack sudo[81036]: pam_unix(sudo:session): session closed for user root
Sep 03 07:52:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.098s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:52:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:52:45 devstack sudo[81049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:52:45 devstack sudo[81049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:52:46 devstack sudo[81049]: pam_unix(sudo:session): session closed for user root
Sep 03 07:52:46 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.978s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:52:46 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:52:47 devstack sudo[81055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:52:47 devstack sudo[81055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:52:48 devstack sudo[81055]: pam_unix(sudo:session): session closed for user root
Sep 03 07:52:48 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.774s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:52:48 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:52:48 devstack sudo[81071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:52:48 devstack sudo[81071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:52:50 devstack sudo[81071]: pam_unix(sudo:session): session closed for user root
Sep 03 07:52:50 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.773s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:52:50 devstack cinder-volume[74757]: DEBUG cinder.manager [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Notifying Schedulers of capabilities ... {{(pid=74757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:53:02 devstack cinder-volume[74757]: DEBUG dbcounter [-] [74757] Writing DB stats cinder:SELECT=1 {{(pid=74757) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:53:02 devstack cinder-volume[74757]: DEBUG dbcounter [-] [74757] Writing DB stats cinder:UPDATE=1 {{(pid=74757) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:53:42 devstack cinder-volume[74757]: DEBUG oslo_service.periodic_task [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74757) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:53:42 devstack cinder-volume[74757]: DEBUG cinder.volume.drivers.lvm [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Updating volume stats {{(pid=74757) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 03 07:53:42 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:53:42 devstack sudo[81256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 03 07:53:42 devstack sudo[81256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:53:44 devstack sudo[81256]: pam_unix(sudo:session): session closed for user root
Sep 03 07:53:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.941s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:53:44 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:53:44 devstack sudo[81267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:53:44 devstack sudo[81267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:53:46 devstack sudo[81267]: pam_unix(sudo:session): session closed for user root
Sep 03 07:53:46 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.971s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:53:46 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:53:46 devstack sudo[81277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 03 07:53:46 devstack sudo[81277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:53:48 devstack sudo[81277]: pam_unix(sudo:session): session closed for user root
Sep 03 07:53:48 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.693s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:53:48 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:53:48 devstack sudo[81281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 03 07:53:48 devstack sudo[81281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:53:50 devstack sudo[81281]: pam_unix(sudo:session): session closed for user root
Sep 03 07:53:50 devstack cinder-volume[74757]: DEBUG oslo_concurrency.processutils [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.823s {{(pid=74757) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:53:50 devstack cinder-volume[74757]: DEBUG cinder.manager [None req-054485f2-6b76-4a02-836f-175cc182bdc2 None None] Notifying Schedulers of capabilities ... {{(pid=74757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:54:23 devstack cinder-volume[74626]: INFO oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Caught SIGTERM, stopping children
Sep 03 07:54:23 devstack cinder-volume[74626]: DEBUG oslo_concurrency.lockutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Acquiring lock "singleton_lock" {{(pid=74626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 03 07:54:23 devstack cinder-volume[74626]: DEBUG oslo_concurrency.lockutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Acquired lock "singleton_lock" {{(pid=74626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 03 07:54:23 devstack cinder-volume[74626]: DEBUG oslo_concurrency.lockutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Releasing lock "singleton_lock" {{(pid=74626) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 03 07:54:23 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Stop services. {{(pid=74626) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 03 07:54:23 devstack cinder-volume[74626]: DEBUG oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Killing children. {{(pid=74626) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 03 07:54:23 devstack cinder-volume[74626]: INFO oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Waiting on 1 children to exit
Sep 03 07:54:24 devstack cinder-volume[74757]: DEBUG oslo_concurrency.lockutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Acquiring lock "singleton_lock" {{(pid=74757) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 03 07:54:24 devstack cinder-volume[74757]: DEBUG oslo_concurrency.lockutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Acquired lock "singleton_lock" {{(pid=74757) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 03 07:54:24 devstack cinder-volume[74757]: DEBUG oslo_concurrency.lockutils [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Releasing lock "singleton_lock" {{(pid=74757) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 03 07:54:24 devstack cinder-volume[74757]: WARNING amqp [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 03 07:54:24 devstack cinder-volume[74757]: WARNING amqp [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 03 07:54:24 devstack cinder-volume[74626]: INFO oslo_service.backend._eventlet.service [None req-8aa15c22-7d0d-4605-98ed-63d18910298b None None] Child 74757 exited with status 0
Sep 03 07:54:42 devstack cinder-volume[82186]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82186) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 03 07:54:42 devstack cinder-volume[82186]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82186) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 03 07:54:42 devstack cinder-volume[82186]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82186) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 03 07:54:45 devstack cinder-volume[82186]: INFO dbcounter [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Registered counter for database cinder
Sep 03 07:54:45 devstack cinder-volume[82186]: DEBUG oslo_db.sqlalchemy.engines [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:54:46 devstack cinder-volume[82186]: DEBUG dbcounter [-] [82186] Writer thread running {{(pid=82186) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 03 07:54:46 devstack cinder-volume[82186]: INFO cinder.rpc [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 03 07:54:46 devstack cinder-volume[82186]: INFO cinder.rpc [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 03 07:54:46 devstack cinder-volume[82186]: DEBUG oslo_db.sqlalchemy.engines [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:54:47 devstack cinder-volume[82186]: INFO cinder.volume.manager [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Determined volume DB was empty at startup.
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG cinder.volume.manager [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82186) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 03 07:54:47 devstack cinder-volume[82186]: INFO cinder.volume.manager [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 03 07:54:47 devstack cinder-volume[82186]: WARNING stevedore.named [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 03 07:54:47 devstack cinder-volume[82186]: WARNING castellan.key_manager [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 03 07:54:47 devstack cinder-volume[82186]: WARNING cinder.keymgr.conf_key_mgr [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 03 07:54:47 devstack cinder-volume[82186]: INFO cinder.volume.manager [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_db.sqlalchemy.engines [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:54:47 devstack cinder-volume[82186]: INFO oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Starting 1 workers
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Started child 82397 {{(pid=82186) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Full set of CONF: {{(pid=82186) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] ******************************************************************************** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Configuration options gathered from: {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] ================================================================================ {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] allow_availability_zone_fallback = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] allow_compression_on_image_upload = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] allowed_direct_url_schemes     = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] api_rate_limit                 = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] auth_strategy                  = keystone {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_availability_zone      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_host                   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_name                   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82397]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_stats_polling_interval = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backup_api_class               = cinder.backup.api.API {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backup_name_template           = backup-%s {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backup_use_same_host           = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backup_use_temp_snapshot       = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] chap_password                  = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] chap_username                  =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_internal_tenant_project_id = 388e0d0646f04593b3f71f9c58cecaf2 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_internal_tenant_user_id = 8e8681dba38f43e68188abd00808d4e8 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cluster                        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] compression_format             = gzip {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] config_dir                     = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] config_source                  = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] control_exchange               = openstack {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] debug                          = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] default_availability_zone      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] default_group_type             = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] default_volume_type            = QuobyteHD {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] driver_client_cert             = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] driver_client_cert_key         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] driver_data_namespace          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] driver_ssl_cert_path           = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] driver_ssl_cert_verify         = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] driver_use_ssl                 = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] enable_new_services            = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] enable_unsupported_driver      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] enforce_multipath_for_image_xfer = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] filter_function                = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_api_insecure            = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_api_ssl_compression     = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_ca_certificates_file    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_certfile                = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_keyfile                 = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_num_retries             = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] glance_request_timeout         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] goodness_function              = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] graceful_shutdown_timeout      = 5 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] group_api_class                = cinder.group.api.API {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] host                           = devstack {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_compress_on_upload       = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_conversion_address_space_limit = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_conversion_cpu_limit     = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_conversion_disable       = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_upload_use_cinder_backend = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_upload_use_internal_tenant = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_volume_cache_enabled     = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_volume_cache_max_count   = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] image_volume_cache_max_size_gb = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] init_host_max_objects_retrieval = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] iscsi_iotype                   = fileio {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] iscsi_target_flags             =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] iscsi_write_cache              = on {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] iser_helper                    = tgtadm {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] iser_ip_address                = 192.168.122.151 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] iser_port                      = 3260 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_color                      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_config_append              = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_dir                        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_file                       = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_options                    = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_rotate_interval            = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_rotate_interval_type       = days {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] log_rotation_type              = none {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] max_age                        = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] max_logfile_count              = 30 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] max_logfile_size_mb            = 200 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] max_over_subscription_ratio    = 20.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] message_reap_interval          = 86400 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] message_ttl                    = 2592000 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] migration_create_volume_timeout_secs = 300 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] monkey_patch                   = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] monkey_patch_modules           = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] my_ip                          = 192.168.122.151 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] no_snapshot_gb_quota           = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] num_iser_scan_tries            = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] num_shell_tries                = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] num_volume_device_scan_tries   = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] nvmeof_conn_info_version       = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] nvmet_ns_id                    = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:47 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] nvmet_port_id                  = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] osapi_max_limit                = 1000 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] osapi_volume_ext_list          = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] osapi_volume_listen_port       = 8776 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] osapi_volume_use_ssl           = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] osapi_volume_workers           = 2 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] per_volume_size_limit          = -1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] periodic_fuzzy_delay           = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] periodic_interval              = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] public_endpoint                = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] publish_errors                 = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] quota_backup_gigabytes         = 1000 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] quota_backups                  = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] quota_gigabytes                = 1000 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] quota_groups                   = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] quota_snapshots                = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] quota_volumes                  = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] rate_limit_burst               = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] rate_limit_except_level        = CRITICAL {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] rate_limit_interval            = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] reinit_driver_count            = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] replication_device             = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] report_discard_supported       = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] report_interval                = 120 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] reservation_clean_interval     = 86400 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] reservation_expire             = 86400 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] reserved_image_namespaces      = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] reserved_percentage            = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] rpc_response_timeout           = 120 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] run_external_periodic_tasks    = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] scst_target_driver             = iscsi {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] scst_target_iqn_name           = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_down_time              = 720 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] shell_completion               = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] snapshot_name_template         = snapshot-%s {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] split_loggers                  = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] state_path                     = /opt/stack/data/cinder {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] storage_availability_zone      = nova {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] storage_protocol               = iSCSI {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] syslog_log_facility            = LOG_USER {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] target_helper                  = lioadm {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] target_ip_address              = 192.168.122.151 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] target_port                    = 3260 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] target_protocol                = iscsi {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] target_secondary_ip_addresses  = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] trace_flags                    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] transport_url                  = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] until_refresh                  = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] use_chap_auth                  = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] use_default_quota_class        = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] use_journal                    = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] use_json                       = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] use_multipath_for_image_xfer   = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] use_stderr                     = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] use_syslog                     = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] verify_glance_signatures       = enabled {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_api_class               = cinder.volume.api.API {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_backend_name            = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_clear                   = zero {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_clear_ionice            = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_clear_size              = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_copy_bps_limit          = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_dd_blocksize            = 1M {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_name_template           = volume-%s {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_service_inithost_offload = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volume_usage_audit_period      = month {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] watch_log_file                 = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] zoning_mode                    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_concurrency.disable_process_locking = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.admin_password = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.admin_token = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.admin_user  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_protocol = https {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_section = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_type   = password {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_uri    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.auth_version = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.cache       = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.certfile    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.identity_uri = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.include_service_catalog = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.insecure    = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.interface   = public {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.keyfile     = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_password =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcache_username =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.region_name = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.service_type = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.backend                  = dogpile.cache.null {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.backend_argument         = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.backend_expiration_time  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.config_prefix            = cache.oslo {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.dead_timeout             = 60.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.debug_cache_backend      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.enable_retry_client      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.enable_socket_keepalive  = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.enabled                  = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.enforce_fips_mode        = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.expiration_time          = 600 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.hashclient_retry_attempts = 2 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_dead_retry      = 300 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_password        = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_sasl_enabled    = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.memcache_username        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.proxies                  = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.redis_db                 = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.redis_password           = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.redis_server             = localhost:6379 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.redis_socket_timeout     = 1.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.redis_username           = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.retry_attempts           = 2 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.retry_delay              = 0.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.socket_keepalive_count   = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.socket_keepalive_idle    = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.socket_keepalive_interval = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82397) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.tls_allowed_ciphers      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.tls_cafile               = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.tls_certfile             = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.tls_enabled              = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cache.tls_keyfile              = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] coordination.backend_url       = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.asyncio_connection    = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.asyncio_slave_connection = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.backend               = sqlalchemy {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.connection            = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.connection_debug      = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.connection_parameters =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.connection_recycle_time = 3600 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.connection_trace      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.db_inc_retry_interval = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.db_max_retries        = 20 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.db_max_retry_interval = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.db_retry_interval     = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.max_overflow          = 50 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.max_pool_size         = 5 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.max_retries           = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.mysql_wsrep_sync_wait = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.pool_timeout          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.retry_interval        = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.slave_connection      = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.sqlite_synchronous    = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] database.use_db_reconnect      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.connection_string     = messaging:// {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.enabled               = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.es_doc_type           = notification {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.es_scroll_size        = 10000 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.es_scroll_time        = 2m {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.filter_error_trace    = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.hmac_keys             = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.sentinel_service_name = mymaster {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.socket_timeout        = 0.1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.trace_requests        = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler.trace_sqlalchemy      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler_jaeger.process_tags   = {} {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler_jaeger.service_name_prefix = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] profiler_otlp.service_name_prefix = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.enforce_new_defaults = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: WARNING oslo_config.cfg [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.enforce_scope      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.policy_default_rule = default {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] privsep_osbrick.group          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] privsep_osbrick.helper_command = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] privsep_osbrick.user           = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_sys_admin.group         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_sys_admin.helper_command = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] cinder_sys_admin.user          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.auth_section      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.auth_type         = password {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.certfile          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.collect_timing    = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.insecure          = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.keyfile           = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.send_service_user_token = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.split_loggers     = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] service_user.timeout           = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.backend_availability_zone = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.chap_password = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.chap_username =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.driver_client_cert = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.driver_client_cert_key = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.driver_data_namespace = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.driver_use_ssl = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.extra_capabilities = {} {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.filter_function = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.goodness_function = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.iscsi_target_flags =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.iscsi_write_cache = on {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.iser_port     = 3260 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_host      =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_login     = admin {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_mount_options = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_password  = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_private_key =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_share_path =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.num_shell_tries = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.quobyte_volume_url = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.replication_device = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.report_discard_supported = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.reserved_percentage = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.target_helper = tgtadm {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.target_port   = 3260 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.target_protocol = iscsi {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.trace_flags   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.unique_fqdn_network = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.use_chap_auth = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_backend_name = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_clear  = zero {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_clear_ionice = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_clear_size = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_reports.file_event_handler = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_reports.log_dir           = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.backend_availability_zone = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.backend_host         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.chap_password        = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.chap_username        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.driver_client_cert   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.driver_data_namespace = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.extra_capabilities   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.filter_function      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.goodness_function    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.iscsi_iotype         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.iser_helper          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.iser_ip_address      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.iser_port            = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_host             = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_login            = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_mount_options    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_password         = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_private_key      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_share_path       = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.num_shell_tries      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82397) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82397]: INFO cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.replication_device   = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.report_discard_supported = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.reserved_percentage  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.scst_target_driver   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.storage_protocol     = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Running cmd (subprocess): mount.quobyte {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.target_helper        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.target_ip_address    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.target_port          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.target_prefix        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.target_protocol      = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.trace_flags          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.use_chap_auth        = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_clear         = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_clear_size    = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] QuobyteHD.volumes_dir          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_notifications.driver = [] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_notifications.retry = -1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] key_manager.fixed_key          = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.barbican_api_version  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.barbican_endpoint     = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.barbican_endpoint_type = public {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.barbican_region_name  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.cafile                = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.certfile              = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.collect_timing        = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.insecure              = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.keyfile               = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.number_of_retries     = 60 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.retry_delay           = 1 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.send_service_user_token = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.split_loggers         = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.timeout               = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.verify_ssl            = True {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican.verify_ssl_path       = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.auth_section = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.auth_type = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.cafile   = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.certfile = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.collect_timing = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.insecure = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.keyfile  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.split_loggers = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] barbican_service_user.timeout  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.approle_role_id          = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.approle_secret_id        = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.kv_mountpoint            = secret {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.kv_path                  = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.kv_version               = 2 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.namespace                = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.root_token_id            = **** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.ssl_ca_crt_file          = None {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.timeout                  = 60.0 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.use_ssl                  = False {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 03 07:54:48 devstack cinder-volume[82186]: DEBUG oslo_service.backend._eventlet.service [None req-86c6fe53-ad08-4256-a129-7c5d9ec3c579 None None] ******************************************************************************** {{(pid=82186) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 03 07:54:48 devstack quobyte-client[82402]: Reading configuration file: /etc/quobyte/client.cfg
Sep 03 07:54:48 devstack quobyte-client[82402]: Invalid parameters found, error: missing mount point.
Sep 03 07:54:48 devstack quobyte-client[82402]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 03 07:54:48 devstack quobyte-client[82402]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] CMD "mount.quobyte" returned: 1 in 0.522s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:54:48 devstack cinder-volume[82397]: INFO cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Mounting volume: 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 ...
Sep 03 07:54:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 -c /etc/quobyte/client-cinder.cfg {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:54:49 devstack quobyte-client[82406]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 03 07:54:49 devstack quobyte-client[82406]: Reading configuration file: /etc/quobyte/client.cfg
Sep 03 07:54:49 devstack quobyte-client[82406]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0' to display the log.
Sep 03 07:54:49 devstack quobyte-client[82407]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 03 07:54:49 devstack quobyte-client[82407]: mount.quobyte 3.25 (4fbbd59204)
Sep 03 07:54:49 devstack quobyte-client[82407]: Client UUID: Hn28dyuz-0iP8-4Vax-KH9b-pVSgoKn177XQ
Sep 03 07:54:49 devstack quobyte-client[82407]: Registry: osci01.corp.quobyte.com:7861
Sep 03 07:54:49 devstack quobyte-client[82407]: Volume: cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 07:54:49 devstack quobyte-client[82407]: FUSE version: 316
Sep 03 07:54:49 devstack quobyte-client[82407]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 03 07:54:49 devstack quobyte-client[82407]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 03 07:54:49 devstack quobyte-client[82407]: Setting total object cache size to 3352297472 bytes
Sep 03 07:54:49 devstack quobyte-client[82407]: Using FUSE low-level API
Sep 03 07:54:49 devstack quobyte-client[82407]: Caching of uid/gid to user/group name mappings is enabled
Sep 03 07:54:49 devstack quobyte-client[82407]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 03 07:54:49 devstack quobyte-client[82407]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 03 07:54:49 devstack quobyte-client[82407]: HTTP server started on port 55000
Sep 03 07:54:49 devstack quobyte-client[82407]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 03 07:54:49 devstack quobyte-client[82407]: Mount point /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 established
Sep 03 07:54:49 devstack quobyte-client[82407]: TimeSync is running and remote sync every 60 seconds
Sep 03 07:54:49 devstack quobyte-client[82407]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 03 07:54:49 devstack quobyte-client[82407]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 03 07:54:49 devstack quobyte-client[82407]: Opening volume cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 (11244876-8419-456b-aa20-0c51b4acc1de)
Sep 03 07:54:49 devstack quobyte-client[82407]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 03 07:54:49 devstack quobyte-client[82407]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 03 07:54:49 devstack quobyte-client[82407]: Failed to invalidate inode: 38: Function not implemented
Sep 03 07:54:49 devstack quobyte-client[82407]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 03 07:54:49 devstack quobyte-client[82407]: Automatic minidump upload enabled by global system configuration
Sep 03 07:54:49 devstack quobyte-client[82407]: Announcing HTTP status server address 172.24.4.1
Sep 03 07:54:49 devstack quobyte-client[82407]: Registered as service (uuid Hn28dyuz-0iP8-4Vax-KH9b-pVSgoKn177XQ)
Sep 03 07:54:49 devstack quobyte-client[82407]: Quobyte Client running as pid 82407
Sep 03 07:54:49 devstack quobyte-client[82407]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 03 07:54:49 devstack quobyte-client[82407]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.557s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:54:49 devstack cinder-volume[82397]: INFO cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Mounting volume: 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 succeeded
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.616s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:54:49 devstack quobyte-client[82407]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.063s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:54:49 devstack cinder-volume[82397]: INFO cinder.volume.driver [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Driver hasn't implemented _init_vendor_properties()
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG cinder.volume.driver [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9363098144531, 'free_capacity_gb': 924.9363098144531, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82397) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG oslo_db.sqlalchemy.engines [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writer thread running {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG cinder.db.sqlalchemy.api [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Building query based on filter {{(pid=82397) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 03 07:54:49 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82397) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 03 07:54:50 devstack cinder-volume[82397]: INFO cinder.keymgr.migration [None req-d4fda38e-34a2-43b5-b9a9-ad1c027f9345 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.064s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:54:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Driver initialization completed successfully.
Sep 03 07:54:50 devstack cinder-volume[82397]: INFO cinder.manager [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Initiating service 3 cleanup
Sep 03 07:54:50 devstack cinder-volume[82397]: INFO cinder.manager [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Service 3 cleanup completed.
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG cinder.service [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Creating RPC server for service cinder-volume {{(pid=82397) start /opt/stack/cinder/cinder/service.py:239}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG cinder.service [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82397) start /opt/stack/cinder/cinder/service.py:245}}
Sep 03 07:54:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 03 07:54:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:54:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:54:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.100s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:54:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-92c722a7-c23f-4b75-9844-e8b93a1cdcb6 None None] Driver post RPC initialization completed successfully.
Sep 03 07:54:52 devstack quobyte-client[82407]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 03 07:54:57 devstack cinder-volume[82186]: DEBUG dbcounter [-] [82186] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82186) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:55:00 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:55:00 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:55:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:55:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:55:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:55:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:55:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:55:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:55:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:55:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.157s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:55:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:56:04 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Flow 'volume_create_manager' (c2deaa49-9bf7-4d18-9aba-a25c3ad4e976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca65e1e-0bba-4da4-a34b-f6249ec803c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca65e1e-0bba-4da4-a34b-f6249ec803c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1047940501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33dc4b5-68f4-470a-9c6a-e108a77048bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce17cef4114598ac175419cd7ad919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:56:04Z,use_quota=True,user_id='699ae91ec0674b0d9b4690f3cb0e8cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f152973-0889-4cf9-988c-c1720b834aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f152973-0889-4cf9-988c-c1720b834aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9784b865-72e1-4636-b044-ca11336caf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9784b865-72e1-4636-b044-ca11336caf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33dc4b5-68f4-470a-9c6a-e108a77048bb', 'volume_name': 'volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b721a1-b909-4305-9a84-39cdac958a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b721a1-b909-4305-9a84-39cdac958a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4072e5d-6955-4bca-a367-113a8fb6983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:56:05 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume e33dc4b5-68f4-470a-9c6a-e108a77048bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb', 'volume_size': 1}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1047940501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33dc4b5-68f4-470a-9c6a-e108a77048bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ce17cef4114598ac175419cd7ad919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:56:04Z,use_quota=True,user_id='699ae91ec0674b0d9b4690f3cb0e8cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Creating volume e33dc4b5-68f4-470a-9c6a-e108a77048bb {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 07:56:05 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 07:56:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:56:05 devstack quobyte-client[82407]: System call of process 82945 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 07:56:06 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=2, name=volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 07:56:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb 1073741824" returned: 0 in 1.215s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:56:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:56:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb" returned: 0 in 0.097s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:56:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] <== create_volume: return (1392ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 07:56:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:56:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4072e5d-6955-4bca-a367-113a8fb6983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:56:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08e73d7-38b6-428d-965d-c24eaf24bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:56:07 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb (e33dc4b5-68f4-470a-9c6a-e108a77048bb): created successfully
Sep 03 07:56:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08e73d7-38b6-428d-965d-c24eaf24bc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:56:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Flow 'volume_create_manager' (c2deaa49-9bf7-4d18-9aba-a25c3ad4e976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:56:07 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2640ae86-3707-42cb-a396-08627d3cc16c tempest-VolumesAssistedSnapshotsTest-1915212605 None] Created volume successfully.
Sep 03 07:56:17 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:56:17 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:56:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:56:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:56:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:56:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:56:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:56:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.079s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:56:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:56:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.229s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:56:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:57:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:57:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:57:07 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Flow 'volume_create_manager' (fe9235b8-ba52-408d-8805-e4191b9b81eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9efbfa2-ec73-42cf-a769-1d35b4930b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9efbfa2-ec73-42cf-a769-1d35b4930b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1302019663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c18c51d-40de-4b79-bb0b-e2a2e6474013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a0d9b212df45fc9a2924309ec07f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:57:06Z,use_quota=True,user_id='5a7eefc8ddba464ebc81caaa8adc5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18d3342-2f90-4981-94bd-4ae590eebe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18d3342-2f90-4981-94bd-4ae590eebe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d0c828-8853-48d7-8fde-f1355a48bcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:57:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d0c828-8853-48d7-8fde-f1355a48bcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c18c51d-40de-4b79-bb0b-e2a2e6474013', 'volume_name': 'volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf49772b-fd0a-41de-b1cf-1b6db292ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf49772b-fd0a-41de-b1cf-1b6db292ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e696aaf2-d533-4a4a-b806-2e0e95bec1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:57:08 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Volume 7c18c51d-40de-4b79-bb0b-e2a2e6474013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013', 'volume_size': 1}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1302019663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c18c51d-40de-4b79-bb0b-e2a2e6474013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a0d9b212df45fc9a2924309ec07f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:57:06Z,use_quota=True,user_id='5a7eefc8ddba464ebc81caaa8adc5fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Creating volume 7c18c51d-40de-4b79-bb0b-e2a2e6474013 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 07:57:08 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 07:57:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:57:08 devstack quobyte-client[82407]: System call of process 83631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 07:57:08 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=3, name=volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 07:57:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013 1073741824" returned: 0 in 1.057s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:57:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:57:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013" returned: 0 in 0.394s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:57:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] <== create_volume: return (1645ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 07:57:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:57:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e696aaf2-d533-4a4a-b806-2e0e95bec1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:57:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832efe3b-3134-4168-a51d-76920ed09e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:57:10 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Volume volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013 (7c18c51d-40de-4b79-bb0b-e2a2e6474013): created successfully
Sep 03 07:57:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832efe3b-3134-4168-a51d-76920ed09e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:57:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Flow 'volume_create_manager' (fe9235b8-ba52-408d-8805-e4191b9b81eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:57:10 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c69377a8-e877-45c7-92bb-7ec43f7bd8cb tempest-VolumesAdminNegativeTest-1182730770 None] Created volume successfully.
Sep 03 07:57:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Acquiring lock "cinder-7c18c51d-40de-4b79-bb0b-e2a2e6474013-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:57:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Lock "cinder-7c18c51d-40de-4b79-bb0b-e2a2e6474013-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:57:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:57:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Acquiring lock "cinder-quobyte-7c18c51d-40de-4b79-bb0b-e2a2e6474013" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:57:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Lock "cinder-quobyte-7c18c51d-40de-4b79-bb0b-e2a2e6474013" acquired by "delete_volume" :: waited 0.036s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:57:14 devstack cinder-volume[82397]: INFO oslo.privsep.daemon [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc0xzc5ue/privsep.sock']
Sep 03 07:57:14 devstack sudo[83638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc0xzc5ue/privsep.sock
Sep 03 07:57:14 devstack sudo[83638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 07:57:24 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:57:24 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:57:28 devstack sudo[83638]: pam_unix(sudo:session): session closed for user root
Sep 03 07:57:28 devstack cinder-volume[82397]: INFO oslo.privsep.daemon [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Spawned new privsep daemon via rootwrap
Sep 03 07:57:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Accepted privsep connection to /tmp/tmpc0xzc5ue/privsep.sock {{(pid=82397) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 03 07:57:28 devstack cinder-volume[82397]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 03 07:57:28 devstack cinder-volume[82397]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 03 07:57:28 devstack cinder-volume[82397]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 03 07:57:28 devstack cinder-volume[82397]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83675
Sep 03 07:57:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef4a6e-88f5-4295-a7ad-ef01601eb7af]: (2,) {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:57:29 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a61019-3b53-4073-b690-d892e05fe4d7]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:57:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:57:30 devstack quobyte-client[82407]: System call of process 83693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 07:57:30 devstack quobyte-client[82407]: System call of process 83693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 07:57:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013" returned: 0 in 1.148s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:57:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:57:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7c18c51d-40de-4b79-bb0b-e2a2e6474013" returned: 0 in 0.259s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:57:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Lock "cinder-quobyte-7c18c51d-40de-4b79-bb0b-e2a2e6474013" released by "delete_volume" :: held 16.511s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:57:31 devstack cinder-volume[82397]: WARNING cinder.quota [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 03 07:57:31 devstack cinder-volume[82397]: WARNING cinder.quota [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Created reservations ['14015e6d-9285-4af2-a0e7-5e9cb605abbe', 'f494f61a-11ad-4f81-b530-48a28e8810cd', '27bb79a4-e7df-494f-b0b7-98bb36974454', '4f5f00e0-7e73-4952-addd-3c0a560bf7e7'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.212s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:57:32 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:57:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Deleted volume successfully.
Sep 03 07:57:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b7d7f0fd-1d07-4368-92f5-46ca96a14b35 tempest-VolumesAdminNegativeTest-1182730770 None] Lock "cinder-7c18c51d-40de-4b79-bb0b-e2a2e6474013-delete_volume" released by "delete_volume" :: held 19.476s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:57:42 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=3,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:57:43 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:58:24 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Flow 'volume_create_manager' (13bcbab4-5adc-4ac9-8ed3-159aeb743d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c540efe-226c-48a7-87aa-52cbe8a97ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c540efe-226c-48a7-87aa-52cbe8a97ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2113141661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0074fad6-d89f-4e79-8cf9-376d1ad90607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162c7534aa64f4e8f118e6ec7090af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:58:24Z,use_quota=True,user_id='d23b25ee9ff64e2b9bb5068f5533c245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd420a7-0840-44bb-9e71-29ca55563865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd420a7-0840-44bb-9e71-29ca55563865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4709b957-251b-4495-9a45-3d31674d9ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4709b957-251b-4495-9a45-3d31674d9ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0074fad6-d89f-4e79-8cf9-376d1ad90607', 'volume_name': 'volume-0074fad6-d89f-4e79-8cf9-376d1ad90607', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22429bb-b17d-4cf6-a934-9f0eb0aeda29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22429bb-b17d-4cf6-a934-9f0eb0aeda29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4509e766-087e-468e-a70b-04363626c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume 0074fad6-d89f-4e79-8cf9-376d1ad90607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0074fad6-d89f-4e79-8cf9-376d1ad90607', 'volume_size': 1}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2113141661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0074fad6-d89f-4e79-8cf9-376d1ad90607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162c7534aa64f4e8f118e6ec7090af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:58:24Z,use_quota=True,user_id='d23b25ee9ff64e2b9bb5068f5533c245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Creating volume 0074fad6-d89f-4e79-8cf9-376d1ad90607 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 07:58:24 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 07:58:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:58:25 devstack quobyte-client[82407]: System call of process 83952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 07:58:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=4, name=volume-0074fad6-d89f-4e79-8cf9-376d1ad90607, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 07:58:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607 1073741824" returned: 0 in 0.999s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:58:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:58:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607" returned: 0 in 0.330s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:58:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] <== create_volume: return (1452ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 07:58:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:58:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4509e766-087e-468e-a70b-04363626c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0074fad6-d89f-4e79-8cf9-376d1ad90607', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37645369-0317-4768-a59f-025ee1707af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume volume-0074fad6-d89f-4e79-8cf9-376d1ad90607 (0074fad6-d89f-4e79-8cf9-376d1ad90607): created successfully
Sep 03 07:58:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37645369-0317-4768-a59f-025ee1707af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Flow 'volume_create_manager' (13bcbab4-5adc-4ac9-8ed3-159aeb743d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:58:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e88a04d7-407b-4622-a8e6-53803501022b tempest-AttachSCSIVolumeTestJSON-896092454 None] Created volume successfully.
Sep 03 07:58:36 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:58:36 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:58:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:58:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:58:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:58:39 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca83f2-c38b-41c2-8324-cb209a5a40de]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:58:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:58:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb" returned: 0 in 0.508s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:58:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.596s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:58:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.661s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:58:40 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[be613bfa-3754-42b9-8585-3808309be9cd]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:58:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:58:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cda3e6f-a026-451e-b523-9633a3b0e175', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 07:58:41 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:58:41 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-0e08f45d-1a7c-48b5-93f1-cf3627387e21 req-c69e4534-88d1-478b-a027-2acf4c1477b8 tempest-VolumesAssistedSnapshotsTest-1915212605 None] attachment_update completed successfully.
Sep 03 07:58:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607" returned: 0 in 0.855s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:58:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:58:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-0074fad6-d89f-4e79-8cf9-376d1ad90607', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09b70cf1-a43d-4fda-8c4f-99e2fa7cb719', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 07:58:41 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:58:41 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-ac54f614-a0bf-4518-9cb1-0b66761d0073 req-372c987a-915b-4a41-a4f1-e5cff6c078b5 tempest-AttachSCSIVolumeTestJSON-896092454 None] attachment_update completed successfully.
Sep 03 07:58:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:58:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:58:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:58:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:58:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:58:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.115s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:58:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:58:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.250s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:58:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:58:51 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:58:57 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Flow 'volume_create_manager' (47ef3bfc-7eef-4e41-b9d4-1ada6e2ba782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3a269d-7c0b-4eea-9e14-6356093e8fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3a269d-7c0b-4eea-9e14-6356093e8fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1917476770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54a40dd-13fc-486b-b16d-9f7f8e110130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24eba70ec85d4bb58c5ee84a6411c6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:58:57Z,use_quota=True,user_id='54d3497c2b644a02949b2e0318efe0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86227e69-af90-47ed-b821-cc606d044941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86227e69-af90-47ed-b821-cc606d044941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20acda1-5e85-4d35-afbd-fd1720152e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20acda1-5e85-4d35-afbd-fd1720152e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54a40dd-13fc-486b-b16d-9f7f8e110130', 'volume_name': 'volume-c54a40dd-13fc-486b-b16d-9f7f8e110130', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a5556-20d9-43c3-85db-d91df2be83c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a5556-20d9-43c3-85db-d91df2be83c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c473262f-e54e-4c5b-8d74-4d557511999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:57 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Volume c54a40dd-13fc-486b-b16d-9f7f8e110130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54a40dd-13fc-486b-b16d-9f7f8e110130', 'volume_size': 1}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T05:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1917476770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54a40dd-13fc-486b-b16d-9f7f8e110130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24eba70ec85d4bb58c5ee84a6411c6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T05:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T05:58:57Z,use_quota=True,user_id='54d3497c2b644a02949b2e0318efe0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Creating volume c54a40dd-13fc-486b-b16d-9f7f8e110130 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 07:58:57 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:58:57 devstack quobyte-client[82407]: System call of process 84522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 07:58:57 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=5, name=volume-c54a40dd-13fc-486b-b16d-9f7f8e110130, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 07:58:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130 1073741824" returned: 0 in 0.424s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130" returned: 0 in 0.180s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c473262f-e54e-4c5b-8d74-4d557511999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54a40dd-13fc-486b-b16d-9f7f8e110130', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c914b0a4-22c1-4421-9683-7ff6e5fd83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 07:58:58 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Volume volume-c54a40dd-13fc-486b-b16d-9f7f8e110130 (c54a40dd-13fc-486b-b16d-9f7f8e110130): created successfully
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c914b0a4-22c1-4421-9683-7ff6e5fd83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 07:58:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Flow 'volume_create_manager' (47ef3bfc-7eef-4e41-b9d4-1ada6e2ba782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 07:58:58 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-61b5dda5-868a-49ba-bf7a-2b7d80250f0f tempest-DeleteServersTestJSON-1223896615 None] Created volume successfully.
Sep 03 07:59:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:59:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:59:04 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c5d14-e758-41ad-b426-b84f23e79af4]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:59:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130" returned: 0 in 0.465s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.545s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:59:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-c54a40dd-13fc-486b-b16d-9f7f8e110130', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1257cd27-7d84-4ebe-8255-84244125390b', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 07:59:05 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-fb20ff86-0dad-4be1-9d79-1ac0365f03fd req-edd10f3a-b93d-41ea-88fa-be2b9ec33416 tempest-DeleteServersTestJSON-1223896615 None] attachment_update completed successfully.
Sep 03 07:59:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-e3166194-8762-422d-be68-aa5cca59fcf5 req-89248b0b-07af-4de8-a8b2-b0a06e670ff1 tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-e3166194-8762-422d-be68-aa5cca59fcf5 req-89248b0b-07af-4de8-a8b2-b0a06e670ff1 tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-e3166194-8762-422d-be68-aa5cca59fcf5 req-89248b0b-07af-4de8-a8b2-b0a06e670ff1 tempest-AttachSCSIVolumeTestJSON-896092454 None] Terminate volume connection completed successfully.
Sep 03 07:59:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-e3166194-8762-422d-be68-aa5cca59fcf5 req-89248b0b-07af-4de8-a8b2-b0a06e670ff1 tempest-AttachSCSIVolumeTestJSON-896092454 None] Deleting attachment 09b70cf1-a43d-4fda-8c4f-99e2fa7cb719. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 07:59:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-2ad57104-61bf-490e-afab-78d8d9daccc1 req-8840b591-e9f4-42e3-9fea-37ca6a410851 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-2ad57104-61bf-490e-afab-78d8d9daccc1 req-8840b591-e9f4-42e3-9fea-37ca6a410851 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-2ad57104-61bf-490e-afab-78d8d9daccc1 req-8840b591-e9f4-42e3-9fea-37ca6a410851 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Terminate volume connection completed successfully.
Sep 03 07:59:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-2ad57104-61bf-490e-afab-78d8d9daccc1 req-8840b591-e9f4-42e3-9fea-37ca6a410851 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Deleting attachment 6cda3e6f-a026-451e-b523-9633a3b0e175. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 07:59:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Acquiring lock "cinder-e33dc4b5-68f4-470a-9c6a-e108a77048bb-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:59:16 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-b45376e0-a4c4-4aaf-99c7-47fa61b2360f req-b2a92cec-6f6b-4b07-8f83-00b248f3967f tempest-DeleteServersTestJSON-1223896615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "cinder-e33dc4b5-68f4-470a-9c6a-e108a77048bb-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:59:16 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-b45376e0-a4c4-4aaf-99c7-47fa61b2360f req-b2a92cec-6f6b-4b07-8f83-00b248f3967f tempest-DeleteServersTestJSON-1223896615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:16 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-b45376e0-a4c4-4aaf-99c7-47fa61b2360f req-b2a92cec-6f6b-4b07-8f83-00b248f3967f tempest-DeleteServersTestJSON-1223896615 None] Terminate volume connection completed successfully.
Sep 03 07:59:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-b45376e0-a4c4-4aaf-99c7-47fa61b2360f req-b2a92cec-6f6b-4b07-8f83-00b248f3967f tempest-DeleteServersTestJSON-1223896615 None] Deleting attachment 1257cd27-7d84-4ebe-8255-84244125390b. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 07:59:16 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Acquiring lock "cinder-quobyte-e33dc4b5-68f4-470a-9c6a-e108a77048bb" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:59:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "cinder-quobyte-e33dc4b5-68f4-470a-9c6a-e108a77048bb" acquired by "delete_volume" :: waited 0.020s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:59:16 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[18261687-da89-4170-8811-bce1a71c37bf]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:59:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb" returned: 0 in 0.459s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e33dc4b5-68f4-470a-9c6a-e108a77048bb" returned: 0 in 0.189s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "cinder-quobyte-e33dc4b5-68f4-470a-9c6a-e108a77048bb" released by "delete_volume" :: held 1.163s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Created reservations ['b2ee2dac-7e5a-42cf-bca6-9f2e3460bfbb', '11c2907d-e9b3-4375-8ab8-717f58b26491', 'aa4dec69-e864-4f30-b3bd-5f70851afb05', 'ec75f4b1-22a4-4e5f-b028-8ab1ce66957b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:59:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.239s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:19 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:59:19 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Deleted volume successfully.
Sep 03 07:59:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-970e41bc-9078-4d1d-82c7-a3303cd74629 tempest-VolumesAssistedSnapshotsTest-1915212605 None] Lock "cinder-e33dc4b5-68f4-470a-9c6a-e108a77048bb-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:59:22 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Acquiring lock "cinder-c54a40dd-13fc-486b-b16d-9f7f8e110130-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:59:22 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Lock "cinder-c54a40dd-13fc-486b-b16d-9f7f8e110130-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:59:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:22 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Acquiring lock "cinder-quobyte-c54a40dd-13fc-486b-b16d-9f7f8e110130" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:59:22 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Lock "cinder-quobyte-c54a40dd-13fc-486b-b16d-9f7f8e110130" acquired by "delete_volume" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:59:22 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce379f92-0acc-430e-accb-abf4ebc34b3a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:59:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130" returned: 0 in 0.385s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c54a40dd-13fc-486b-b16d-9f7f8e110130" returned: 0 in 0.240s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Lock "cinder-quobyte-c54a40dd-13fc-486b-b16d-9f7f8e110130" released by "delete_volume" :: held 0.950s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Created reservations ['eb1ae9fa-9862-4087-9126-91ff86ee16c5', 'b0a08c47-52fc-41df-b57f-9d296865d06c', '84ecc7f7-83d6-4fbf-b92b-5183279017c4', '6604d422-1939-4567-8b15-1e8de91bb878'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.075s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:24 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:59:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Deleted volume successfully.
Sep 03 07:59:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ef33f2c-e959-4615-838c-5b3c50fde615 tempest-DeleteServersTestJSON-1223896615 None] Lock "cinder-c54a40dd-13fc-486b-b16d-9f7f8e110130-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:59:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Acquiring lock "cinder-0074fad6-d89f-4e79-8cf9-376d1ad90607-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:59:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "cinder-0074fad6-d89f-4e79-8cf9-376d1ad90607-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:59:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 07:59:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Acquiring lock "cinder-quobyte-0074fad6-d89f-4e79-8cf9-376d1ad90607" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 07:59:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "cinder-quobyte-0074fad6-d89f-4e79-8cf9-376d1ad90607" acquired by "delete_volume" :: waited 0.026s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 07:59:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a355554e-65aa-4ab7-b12d-bd042946d4f2]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 07:59:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:28 devstack quobyte-client[82407]: System call of process 84750 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 07:59:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607" returned: 0 in 0.568s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0074fad6-d89f-4e79-8cf9-376d1ad90607" returned: 0 in 0.172s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "cinder-quobyte-0074fad6-d89f-4e79-8cf9-376d1ad90607" released by "delete_volume" :: held 0.966s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Created reservations ['4968d2db-0760-4816-b126-5fdab173e49a', '9acc756e-cfb9-42dd-a582-efc1f00c9483', '09b33e13-3c5a-447f-9944-dc043789c8d6', 'eb3a6c4f-56a6-452c-8877-1baac83a8507'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:29 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 07:59:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Deleted volume successfully.
Sep 03 07:59:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-144024f4-35df-4ad8-9d0b-18458d5da9df tempest-AttachSCSIVolumeTestJSON-896092454 None] Lock "cinder-0074fad6-d89f-4e79-8cf9-376d1ad90607-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 07:59:39 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:59:40 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=39,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=9 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 07:59:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 07:59:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 07:59:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 07:59:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 07:59:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 07:59:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 07:59:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 07:59:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.121s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 07:59:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:00:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Flow 'volume_create_manager' (a24e1f04-54fe-43cb-bade-b98c3cf9fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ede21e7-fd77-4640-aa5f-fb671f41c427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ede21e7-fd77-4640-aa5f-fb671f41c427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2040645215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b7ce44-ab7a-4b68-90e3-3213c4bdcb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c1dbd7ba2c40528b341af85f953dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:23Z,use_quota=True,user_id='5111d992cfd3456fa445318ecc9bc661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6029c0-d4c7-4966-aa85-8d8ac4241d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6029c0-d4c7-4966-aa85-8d8ac4241d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e4bb7a-2d23-43d3-80dc-08ca5835b91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e4bb7a-2d23-43d3-80dc-08ca5835b91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b7ce44-ab7a-4b68-90e3-3213c4bdcb45', 'volume_name': 'volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9848de7f-eea6-4515-85c2-8af9de0f2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9848de7f-eea6-4515-85c2-8af9de0f2f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c813ac3-075e-4859-b78d-9269ae746fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Volume 39b7ce44-ab7a-4b68-90e3-3213c4bdcb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45', 'volume_size': 1}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2040645215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b7ce44-ab7a-4b68-90e3-3213c4bdcb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c1dbd7ba2c40528b341af85f953dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:23Z,use_quota=True,user_id='5111d992cfd3456fa445318ecc9bc661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Creating volume 39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:00:23 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:00:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:23 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=6, name=volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 1073741824" returned: 0 in 0.476s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45" returned: 0 in 0.119s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] <== create_volume: return (660ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c813ac3-075e-4859-b78d-9269ae746fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef27d909-808f-416a-9524-612286513629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Volume volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 (39b7ce44-ab7a-4b68-90e3-3213c4bdcb45): created successfully
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef27d909-808f-416a-9524-612286513629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Flow 'volume_create_manager' (a24e1f04-54fe-43cb-bade-b98c3cf9fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:00:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5ea757c6-03a2-4d82-8048-417903b7d19b tempest-TaggedAttachmentsTest-665670353 None] Created volume successfully.
Sep 03 08:00:34 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:00:34 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:00:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:00:36 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:00:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Flow 'volume_create_manager' (50852521-0d67-4da3-a583-fdd285efa505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:00:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188ee575-d020-4167-9295-b1e9f58e08a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188ee575-d020-4167-9295-b1e9f58e08a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-639460454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28f2ff7-d4b9-4914-8f3e-085d928ce279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f12841127f14f35a2384783e2700dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:36Z,use_quota=True,user_id='9eb30b8dc3da44f0921af21b9487f261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fde1de-21fc-4936-a6ba-6fb9eee8039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fde1de-21fc-4936-a6ba-6fb9eee8039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6ff864-b52d-4a4a-af59-d0333b9a79ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6ff864-b52d-4a4a-af59-d0333b9a79ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a28f2ff7-d4b9-4914-8f3e-085d928ce279', 'volume_name': 'volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b691dd600>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebbd19d-8037-4592-a6c5-0d0a7d4efeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ebbd19d-8037-4592-a6c5-0d0a7d4efeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0332c8f-4f96-41be-8211-a74b8b8c272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:37 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Volume a28f2ff7-d4b9-4914-8f3e-085d928ce279: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b691dd600>}
Sep 03 08:00:37 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Cloning a28f2ff7-d4b9-4914-8f3e-085d928ce279 from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22  at location (None, None). {{(pid=82397) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}}
Sep 03 08:00:37 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 03 08:00:37 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Image download 20.69 MB at 20.69 MB/s
Sep 03 08:00:37 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5bda64-3c34-461b-ad17-5e29f192a77f]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:00:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:38 devstack sudo[84848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD
Sep 03 08:00:38 devstack sudo[84848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:00:40 devstack sudo[84848]: pam_unix(sudo:session): session closed for user root
Sep 03 08:00:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD" returned: 0 in 2.231s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:40 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 is fetched for user 9eb30b8dc3da44f0921af21b9487f261. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 03 08:00:40 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[06886da9-2e06-4eed-bb6e-0430a0673f7a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:00:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:41 devstack sudo[84854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD
Sep 03 08:00:41 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:00:43 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD" returned: 0 in 2.979s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-639460454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28f2ff7-d4b9-4914-8f3e-085d928ce279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f12841127f14f35a2384783e2700dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:36Z,use_quota=True,user_id='9eb30b8dc3da44f0921af21b9487f261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Creating volume a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:00:43 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:00:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:43 devstack quobyte-client[82407]: System call of process 84863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:00:43 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=7, name=volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:00:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 1073741824" returned: 0 in 0.530s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 0 in 0.142s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] <== create_volume: return (825ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:00:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:44 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Attempting download of 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume a28f2ff7-d4b9-4914-8f3e-085d928ce279. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 03 08:00:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[929220c7-dd8a-4d7a-960b-91b4600ff86a]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:00:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_mr87jg5z {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_mr87jg5z" returned: 0 in 0.936s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_mr87jg5z {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_mr87jg5z" returned: 1 in 0.976s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_mr87jg5z' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a93ed8c-7b04-4562-9a55-0ce18e559038]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] 870a0d94-8d05-4c7b-aab1-1837efb2cb22 was qcow2, converting to raw {{(pid=82397) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:48 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=7, name=volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.227s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:00:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 0 in 2.321s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:50 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_7eewtj53devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:00:50 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Converted 112.00 MB image at 47.77 MB/s
Sep 03 08:00:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 1G" returned: 0 in 0.189s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b0e9cf-1d74-4ec9-aab1-98c6d0bb4832]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:00:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 0 in 1.008s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:52 devstack quobyte-client[82407]: System call of process 84913 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 1 in 0.691s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Downloaded image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume a28f2ff7-d4b9-4914-8f3e-085d928ce279 successfully. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 for user 9eb30b8dc3da44f0921af21b9487f261 is deleted. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Marking volume a28f2ff7-d4b9-4914-8f3e-085d928ce279 as bootable. {{(pid=82397) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Copying metadata from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 to a28f2ff7-d4b9-4914-8f3e-085d928ce279. {{(pid=82397) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Creating volume glance metadata for volume a28f2ff7-d4b9-4914-8f3e-085d928ce279 backed by image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82397) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0332c8f-4f96-41be-8211-a74b8b8c272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b691dd600>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204ff100-7e04-470c-bb0e-34ea3cd1ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:52 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Volume volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 (a28f2ff7-d4b9-4914-8f3e-085d928ce279): created successfully
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204ff100-7e04-470c-bb0e-34ea3cd1ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Flow 'volume_create_manager' (50852521-0d67-4da3-a583-fdd285efa505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:00:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-00df9b3b-be3c-4c60-8e18-981434521152 tempest-TaggedBootDevicesTest-947552511 None] Created volume successfully.
Sep 03 08:00:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Flow 'volume_create_manager' (9f47ff25-4102-47c7-b7ba-f82f791b24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438f1575-1ae7-490b-b414-9005ce58d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438f1575-1ae7-490b-b414-9005ce58d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1311470602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c0c679-ac74-4e20-be07-abd50466f280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f12841127f14f35a2384783e2700dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:54Z,use_quota=True,user_id='9eb30b8dc3da44f0921af21b9487f261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118473c6-291c-414d-9cc7-9310606293c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118473c6-291c-414d-9cc7-9310606293c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb2ed63-9ed7-4d78-be4b-1b0866e2508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb2ed63-9ed7-4d78-be4b-1b0866e2508f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c0c679-ac74-4e20-be07-abd50466f280', 'volume_name': 'volume-c6c0c679-ac74-4e20-be07-abd50466f280', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d636f5-f6f7-4049-8745-4567962ec335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d636f5-f6f7-4049-8745-4567962ec335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8ac5ab-5d2f-4698-9243-474f886ca21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:54 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Volume c6c0c679-ac74-4e20-be07-abd50466f280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c0c679-ac74-4e20-be07-abd50466f280', 'volume_size': 1}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1311470602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c0c679-ac74-4e20-be07-abd50466f280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f12841127f14f35a2384783e2700dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:54Z,use_quota=True,user_id='9eb30b8dc3da44f0921af21b9487f261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Creating volume c6c0c679-ac74-4e20-be07-abd50466f280 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:00:54 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:54 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=8, name=volume-c6c0c679-ac74-4e20-be07-abd50466f280, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:00:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280 1073741824" returned: 0 in 0.426s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280" returned: 0 in 0.236s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] <== create_volume: return (759ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8ac5ab-5d2f-4698-9243-474f886ca21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c0c679-ac74-4e20-be07-abd50466f280', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d780c833-6e86-446a-af0a-c25bb23dd65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:55 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Volume volume-c6c0c679-ac74-4e20-be07-abd50466f280 (c6c0c679-ac74-4e20-be07-abd50466f280): created successfully
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d780c833-6e86-446a-af0a-c25bb23dd65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Flow 'volume_create_manager' (9f47ff25-4102-47c7-b7ba-f82f791b24e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:00:55 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-40ce9813-365c-4f19-9d9c-146d14af7c96 tempest-TaggedBootDevicesTest-947552511 None] Created volume successfully.
Sep 03 08:00:57 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Flow 'volume_create_manager' (9d851e56-fab1-4814-8730-50e4957a6259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee166cf-bea0-489c-820e-92b276e4ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee166cf-bea0-489c-820e-92b276e4ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1125387361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f74d25-92ab-46f9-ac82-7fdaddbd948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f12841127f14f35a2384783e2700dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:57Z,use_quota=True,user_id='9eb30b8dc3da44f0921af21b9487f261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f0b81f-16ea-4732-aaf8-d6ccb62eadc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f0b81f-16ea-4732-aaf8-d6ccb62eadc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e17731-f03c-4ed7-8fee-e142d0bf0318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e17731-f03c-4ed7-8fee-e142d0bf0318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f74d25-92ab-46f9-ac82-7fdaddbd948a', 'volume_name': 'volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c0889e-b8ea-4bc1-9fa2-71509790c0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c0889e-b8ea-4bc1-9fa2-71509790c0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d89559-f1c8-44ca-aa29-aee3dc6fc3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:00:58 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Volume 41f74d25-92ab-46f9-ac82-7fdaddbd948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a', 'volume_size': 1}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1125387361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f74d25-92ab-46f9-ac82-7fdaddbd948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f12841127f14f35a2384783e2700dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:00:57Z,use_quota=True,user_id='9eb30b8dc3da44f0921af21b9487f261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Creating volume 41f74d25-92ab-46f9-ac82-7fdaddbd948a {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:00:58 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:00:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:00:58 devstack quobyte-client[82407]: System call of process 85004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:00:59 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=9, name=volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:00:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a 1073741824" returned: 0 in 0.995s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:00:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:01:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a" returned: 0 in 0.339s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:01:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] <== create_volume: return (1596ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:01:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:01:00 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d89559-f1c8-44ca-aa29-aee3dc6fc3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:01:00 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a325fc-7d2a-415a-aac1-5621df25a6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:01:00 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Volume volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a (41f74d25-92ab-46f9-ac82-7fdaddbd948a): created successfully
Sep 03 08:01:00 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a325fc-7d2a-415a-aac1-5621df25a6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:01:00 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Flow 'volume_create_manager' (9d851e56-fab1-4814-8730-50e4957a6259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:01:01 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8aaf70c0-d8b0-4c53-b00f-bbfd7928ef79 tempest-TaggedBootDevicesTest-947552511 None] Created volume successfully.
Sep 03 08:01:10 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=9,cinder:SELECT=10,cinder:INSERT=7,cinder:DELETE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:01:11 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:01:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:01:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:01:48 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff03504-b3a3-46eb-b8b3-9791e407b8e1]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:01:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:01:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.746s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:01:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:01:49 devstack quobyte-client[82407]: System call of process 85259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:01:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 0 in 1.556s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:01:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:01:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 1 in 1.033s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:01:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:01:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.263s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:01:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '557769c9-c983-4bfc-96b3-a1a57eea3ae7', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:01:51 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:01:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-fcfceecf-ffe1-47bd-a2a3-deb42acb86e9 tempest-TaggedBootDevicesTest-947552511 None] attachment_update completed successfully.
Sep 03 08:01:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:01:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:01:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fee9d9-d4b4-4dee-8d5d-12a89920e9be]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:01:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:01:57 devstack quobyte-client[82407]: System call of process 85274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:01:57 devstack quobyte-client[82407]: System call of process 85274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:01:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280" returned: 0 in 1.303s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:01:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.465s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:01:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-c6c0c679-ac74-4e20-be07-abd50466f280', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2b94338-3f16-4ae8-bfde-6ab0ab94c006', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:01:57 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:01:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-7af72fa0-1b52-42f8-8b32-6d7898389912 tempest-TaggedBootDevicesTest-947552511 None] attachment_update completed successfully.
Sep 03 08:02:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:02:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:02:02 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c00795-cb91-45b8-bce6-c56f4b94d005]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:02:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:02:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a" returned: 0 in 0.719s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:02:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:02:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '657cb489-ed08-4dd8-a17d-5c438b995505', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:02:03 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:02:03 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-42a2ee14-c4c5-4859-9f01-90a7b800994d req-d171507e-4b62-472e-ae6e-8b08ac5a8d81 tempest-TaggedBootDevicesTest-947552511 None] attachment_update completed successfully.
Sep 03 08:02:13 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:02:13 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=20,cinder:UPDATE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:02:29 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:02:29 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Flow 'volume_create_manager' (26a82814-b650-4904-84cc-e05827e9fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b82a0f-7283-4b2e-af1b-867e60f92f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b82a0f-7283-4b2e-af1b-867e60f92f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-323839255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c14a31-d99c-4801-ac6b-bdd09b5f934c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfcac6480f94a8c9b80ebf3269cc0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:02:29Z,use_quota=True,user_id='ab29d9cdfeb5426ba3203394efc74aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eef743-ed96-4d45-8417-bdda09adae31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eef743-ed96-4d45-8417-bdda09adae31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1002b436-59fa-4de9-a590-41d671dcae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1002b436-59fa-4de9-a590-41d671dcae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c14a31-d99c-4801-ac6b-bdd09b5f934c', 'volume_name': 'volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42306015-5823-4d15-8401-3368e467afe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42306015-5823-4d15-8401-3368e467afe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddb459b-994f-48e5-a484-5fe048d75bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:02:30 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume e3c14a31-d99c-4801-ac6b-bdd09b5f934c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c', 'volume_size': 1}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-323839255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c14a31-d99c-4801-ac6b-bdd09b5f934c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfcac6480f94a8c9b80ebf3269cc0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:02:29Z,use_quota=True,user_id='ab29d9cdfeb5426ba3203394efc74aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Creating volume e3c14a31-d99c-4801-ac6b-bdd09b5f934c {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:02:30 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:02:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:02:31 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=10, name=volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:02:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c 1073741824" returned: 0 in 1.755s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:02:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:02:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c" returned: 0 in 0.332s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:02:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] <== create_volume: return (2414ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:02:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.622s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:02:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddb459b-994f-48e5-a484-5fe048d75bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:02:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd45d17-b14e-4f8b-aaf5-8c3c36ece94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:02:33 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c (e3c14a31-d99c-4801-ac6b-bdd09b5f934c): created successfully
Sep 03 08:02:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd45d17-b14e-4f8b-aaf5-8c3c36ece94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:02:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Flow 'volume_create_manager' (26a82814-b650-4904-84cc-e05827e9fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:02:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-325d14ec-23cf-4c26-868e-52915704cb24 tempest-AttachVolumeShelveTestJSON-1388624222 None] Created volume successfully.
Sep 03 08:02:43 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:02:44 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:02:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:02:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:02:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:02:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:02:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:02:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:02:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:02:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.507s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:02:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:02:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:02:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:02:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b59e98-249a-4531-aa76-3d4986533327]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:02:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:02:52 devstack quobyte-client[82407]: System call of process 86280 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:02:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45" returned: 0 in 1.742s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:02:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.880s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:02:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d4883b3-09b3-4982-a9f3-3747c0862279', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:02:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:02:53 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-6ae486dc-e7dd-419c-baca-e53b480daae9 req-c1119e0b-2677-44bf-8082-395552af323f tempest-TaggedAttachmentsTest-665670353 None] attachment_update completed successfully.
Sep 03 08:03:02 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:03:03 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:03:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:03:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:03:18 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c96a584-24b2-4951-a95b-9c3f2a524be0]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:03:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:03:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c" returned: 0 in 0.449s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:03:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.602s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:03:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0a7f164-5206-4a01-b064-b1293f5c7ba0', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:03:19 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:03:19 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-7585b73a-283a-441b-9f7b-ab9521ede263 req-6ad6c2e8-33b2-422f-8abf-5e14d2b960e2 tempest-AttachVolumeShelveTestJSON-1388624222 None] attachment_update completed successfully.
Sep 03 08:03:29 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:03:29 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:03:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-1be9e846-2205-4128-b77e-05ecd88ee6bb req-d5e78e2e-664a-46ec-8dff-ec2d64a27f4a tempest-TaggedAttachmentsTest-665670353 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:03:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-1be9e846-2205-4128-b77e-05ecd88ee6bb req-d5e78e2e-664a-46ec-8dff-ec2d64a27f4a tempest-TaggedAttachmentsTest-665670353 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:03:30 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-1be9e846-2205-4128-b77e-05ecd88ee6bb req-d5e78e2e-664a-46ec-8dff-ec2d64a27f4a tempest-TaggedAttachmentsTest-665670353 None] Terminate volume connection completed successfully.
Sep 03 08:03:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-1be9e846-2205-4128-b77e-05ecd88ee6bb req-d5e78e2e-664a-46ec-8dff-ec2d64a27f4a tempest-TaggedAttachmentsTest-665670353 None] Deleting attachment 4d4883b3-09b3-4982-a9f3-3747c0862279. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:03:40 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:03:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:03:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:03:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:03:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:03:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:03:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:03:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:03:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.138s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:03:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:04:21 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Acquiring lock "cinder-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:04:21 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Lock "cinder-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:04:21 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:21 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Acquiring lock "cinder-quobyte-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:04:21 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Lock "cinder-quobyte-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45" acquired by "delete_volume" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:04:22 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e04a5ae-5793-443e-8612-5c9f75039034]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:04:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:04:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45" returned: 0 in 0.435s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:04:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:04:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45" returned: 0 in 0.117s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:04:22 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Lock "cinder-quobyte-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45" released by "delete_volume" :: held 0.709s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:04:22 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Created reservations ['0e3fa3c2-c956-49de-81b1-74fa6a84b6bd', 'e5e86397-3367-4569-a878-8b1eba060019', '264fc35e-1f12-4c20-a10c-6fa75cf2dcea', '57ba85b2-3b7a-4189-a565-4d92c448c142'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.106s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:04:23 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Deleted volume successfully.
Sep 03 08:04:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4afe056a-47b1-4508-b7d1-470fe6b84e6f tempest-TaggedAttachmentsTest-665670353 None] Lock "cinder-39b7ce44-ab7a-4b68-90e3-3213c4bdcb45-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:04:33 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:04:33 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:04:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-369c994e-4a6f-4265-8425-560dc09b841b tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-369c994e-4a6f-4265-8425-560dc09b841b tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-369c994e-4a6f-4265-8425-560dc09b841b tempest-TaggedBootDevicesTest-947552511 None] Terminate volume connection completed successfully.
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-369c994e-4a6f-4265-8425-560dc09b841b tempest-TaggedBootDevicesTest-947552511 None] Deleting attachment 557769c9-c983-4bfc-96b3-a1a57eea3ae7. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:04:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-178108bf-82ff-43a7-84de-ed4f27d3f734 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-178108bf-82ff-43a7-84de-ed4f27d3f734 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-178108bf-82ff-43a7-84de-ed4f27d3f734 tempest-TaggedBootDevicesTest-947552511 None] Terminate volume connection completed successfully.
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-178108bf-82ff-43a7-84de-ed4f27d3f734 tempest-TaggedBootDevicesTest-947552511 None] Deleting attachment c2b94338-3f16-4ae8-bfde-6ab0ab94c006. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:04:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:04:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:04:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:04:48 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-142dfe23-78af-40f1-9b5c-87e70df2832c tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:48 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-142dfe23-78af-40f1-9b5c-87e70df2832c tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-142dfe23-78af-40f1-9b5c-87e70df2832c tempest-TaggedBootDevicesTest-947552511 None] Terminate volume connection completed successfully.
Sep 03 08:04:48 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-70ab6157-42c9-475e-84b5-b8131dce0861 req-142dfe23-78af-40f1-9b5c-87e70df2832c tempest-TaggedBootDevicesTest-947552511 None] Deleting attachment 657cb489-ed08-4dd8-a17d-5c438b995505. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:04:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "cinder-41f74d25-92ab-46f9-ac82-7fdaddbd948a-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:04:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-41f74d25-92ab-46f9-ac82-7fdaddbd948a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:04:58 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:04:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "cinder-quobyte-41f74d25-92ab-46f9-ac82-7fdaddbd948a" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:04:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-quobyte-41f74d25-92ab-46f9-ac82-7fdaddbd948a" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:04:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c77f9-0493-4485-828a-0a17e9c4dbef]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:04:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a" returned: 0 in 0.617s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-41f74d25-92ab-46f9-ac82-7fdaddbd948a" returned: 0 in 0.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-quobyte-41f74d25-92ab-46f9-ac82-7fdaddbd948a" released by "delete_volume" :: held 0.927s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Created reservations ['46227fdc-53f9-4dac-8023-6c44ad8b84fd', '5183fb82-104b-4eaf-aa65-76f48718446b', '368302fd-20dd-4a7d-a73b-3c9bb385dd1e', 'db10d243-ea74-49f1-ad98-2649e12cfe4f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.132s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:04:59 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:05:00 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Deleted volume successfully.
Sep 03 08:05:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5c6d5ddf-41d5-4a1b-b461-3ab2bfcea0e0 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-41f74d25-92ab-46f9-ac82-7fdaddbd948a-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "cinder-c6c0c679-ac74-4e20-be07-abd50466f280-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:05:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-c6c0c679-ac74-4e20-be07-abd50466f280-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:05:00 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "cinder-quobyte-c6c0c679-ac74-4e20-be07-abd50466f280" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:05:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-quobyte-c6c0c679-ac74-4e20-be07-abd50466f280" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:05:01 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9b8056-46f7-45d0-903b-f5cfb4c30a3a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:05:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280" returned: 0 in 0.536s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c6c0c679-ac74-4e20-be07-abd50466f280" returned: 0 in 0.129s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-quobyte-c6c0c679-ac74-4e20-be07-abd50466f280" released by "delete_volume" :: held 0.824s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:02 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Created reservations ['b2408282-c276-4589-b606-5b8580d8721a', 'a36aa118-50ad-4446-9632-bfa4efa298d0', 'd64f8596-aeef-48fa-94c0-2e540beaadb4', '2ff5cab9-e4a7-4551-bd6c-8c7a74b9ef65'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:05:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:05:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:05:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:05:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:05:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:05:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.171s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:03 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:05:03 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Deleted volume successfully.
Sep 03 08:05:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "cinder-a28f2ff7-d4b9-4914-8f3e-085d928ce279-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:05:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b783c519-90ac-4063-be81-f35f43d3065b tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-c6c0c679-ac74-4e20-be07-abd50466f280-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-a28f2ff7-d4b9-4914-8f3e-085d928ce279-delete_volume" acquired by "delete_volume" :: waited 0.199s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:05:04 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "cinder-quobyte-a28f2ff7-d4b9-4914-8f3e-085d928ce279" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:05:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-quobyte-a28f2ff7-d4b9-4914-8f3e-085d928ce279" acquired by "delete_volume" :: waited 0.023s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:05:04 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[af173cc3-7dc6-42eb-a023-fecf46f4c60f]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:05:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:05 devstack quobyte-client[82407]: System call of process 87155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:05:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 0 in 1.278s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 1 in 1.274s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:05:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a28f2ff7-d4b9-4914-8f3e-085d928ce279" returned: 0 in 0.261s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:07 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-quobyte-a28f2ff7-d4b9-4914-8f3e-085d928ce279" released by "delete_volume" :: held 3.323s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Created reservations ['fe61d0b7-e73a-426f-a1d4-dfd1cd629bc0', 'd56a9421-a1ff-4e1c-b59b-3e7794a6412a', 'b9d4b21f-2633-4acc-a065-e25ba1899ba4', '6e4d8ca3-ffb1-4085-b0b5-7cede3506f4f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.137s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:08 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:05:09 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Deleted volume successfully.
Sep 03 08:05:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4ff6547a-7e21-4094-8953-9c2ea83c5e35 tempest-TaggedBootDevicesTest-947552511 None] Lock "cinder-a28f2ff7-d4b9-4914-8f3e-085d928ce279-delete_volume" released by "delete_volume" :: held 5.575s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:18 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=22,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:05:19 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=15,cinder:UPDATE=19,cinder:INSERT=8,cinder:DELETE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:05:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-2cca9eff-b7e2-45c4-b854-8f8750c6579c req-61a11de9-8579-4b24-a419-e0b890c81228 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:34 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-2cca9eff-b7e2-45c4-b854-8f8750c6579c req-61a11de9-8579-4b24-a419-e0b890c81228 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-2cca9eff-b7e2-45c4-b854-8f8750c6579c req-61a11de9-8579-4b24-a419-e0b890c81228 tempest-AttachVolumeShelveTestJSON-1388624222 None] Terminate volume connection completed successfully.
Sep 03 08:05:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-2cca9eff-b7e2-45c4-b854-8f8750c6579c req-61a11de9-8579-4b24-a419-e0b890c81228 tempest-AttachVolumeShelveTestJSON-1388624222 None] Deleting attachment f0a7f164-5206-4a01-b064-b1293f5c7ba0. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:05:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-63c57cdd-49c6-4f0a-abd8-2e0cbcaa395e tempest-GroupSnapshotsV319Test-365165701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-63c57cdd-49c6-4f0a-abd8-2e0cbcaa395e tempest-GroupSnapshotsV319Test-365165701 None] Group tempest-GroupSnapshotsV319Test-Group-2043071067: creating
Sep 03 08:05:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-63c57cdd-49c6-4f0a-abd8-2e0cbcaa395e tempest-GroupSnapshotsV319Test-365165701 None] Group tempest-GroupSnapshotsV319Test-Group-2043071067: created successfully
Sep 03 08:05:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-63c57cdd-49c6-4f0a-abd8-2e0cbcaa395e tempest-GroupSnapshotsV319Test-365165701 None] Create group completed successfully.
Sep 03 08:05:39 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:39 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:05:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Flow 'volume_create_manager' (954d8003-7f87-4186-898b-6022e72b339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:05:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19ab876-1af1-43f5-8ece-d7241b43a535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19ab876-1af1-43f5-8ece-d7241b43a535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1215896614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c4c590f-0aa7-445b-90ca-0caec9b11bb1,host='devstack@QuobyteHD#QuobyteHD',id=30df4c45-9d5c-4469-934d-8ca139747ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f8bd08e7ed40c68496ed37492e28f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:05:40Z,use_quota=True,user_id='a7b898e3f3014bf6b1018846ce526aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7449c6a-7e86-4181-951e-5f6384e9a7ee),volume_type_id=b7449c6a-7e86-4181-951e-5f6384e9a7ee)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57554ba-7d4e-4300-adf4-03f8a44964e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57554ba-7d4e-4300-adf4-03f8a44964e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0d47ed-a1a4-44ad-971e-4f542708656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0d47ed-a1a4-44ad-971e-4f542708656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30df4c45-9d5c-4469-934d-8ca139747ee5', 'volume_name': 'volume-30df4c45-9d5c-4469-934d-8ca139747ee5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0a6ca0-b401-496f-85d1-1b0fb5337b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0a6ca0-b401-496f-85d1-1b0fb5337b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e756ee9-40ec-427d-b3ee-4b4d2f3009eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:05:40 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Volume 30df4c45-9d5c-4469-934d-8ca139747ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30df4c45-9d5c-4469-934d-8ca139747ee5', 'volume_size': 1}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3c4c590f-0aa7-445b-90ca-0caec9b11bb1,created_at=2025-09-03T06:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1215896614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c4c590f-0aa7-445b-90ca-0caec9b11bb1,host='devstack@QuobyteHD#QuobyteHD',id=30df4c45-9d5c-4469-934d-8ca139747ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f8bd08e7ed40c68496ed37492e28f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:05:40Z,use_quota=True,user_id='a7b898e3f3014bf6b1018846ce526aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7449c6a-7e86-4181-951e-5f6384e9a7ee),volume_type_id=b7449c6a-7e86-4181-951e-5f6384e9a7ee)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Creating volume 30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:05:40 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:40 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=11, name=volume-30df4c45-9d5c-4469-934d-8ca139747ee5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 1073741824" returned: 0 in 0.575s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5" returned: 0 in 0.332s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] <== create_volume: return (1130ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:05:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:05:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e756ee9-40ec-427d-b3ee-4b4d2f3009eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30df4c45-9d5c-4469-934d-8ca139747ee5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:05:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1374fd08-bbef-473b-918e-7bfa61921056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:05:41 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Volume volume-30df4c45-9d5c-4469-934d-8ca139747ee5 (30df4c45-9d5c-4469-934d-8ca139747ee5): created successfully
Sep 03 08:05:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1374fd08-bbef-473b-918e-7bfa61921056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:05:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Flow 'volume_create_manager' (954d8003-7f87-4186-898b-6022e72b339f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:05:41 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-145b1af5-a162-4a87-8fd0-fd84df158169 tempest-GroupSnapshotsV319Test-365165701 None] Created volume successfully.
Sep 03 08:05:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] GroupSnapshot ca6e1a6f-a672-4733-8644-606620e35b45: creating.
Sep 03 08:05:43 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Group snapshot ca6e1a6f-a672-4733-8644-606620e35b45: creating. {{(pid=82397) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 03 08:05:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:05:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:05:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Creating offline snapshot 43da26b0-d6be-4722-b187-a2671d15f4aa of volume 30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:05:43 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[006ee7aa-05d7-4444-aaf3-74e7d97a2cc0]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:05:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:44 devstack quobyte-client[82407]: System call of process 87362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:05:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5" returned: 0 in 0.625s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:44 devstack quobyte-client[82407]: System call of process 87365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:05:44 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=12, name=volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:05:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa 1G" returned: 0 in 0.355s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): qemu-img rebase -u -b volume-30df4c45-9d5c-4469-934d-8ca139747ee5 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:44 devstack quobyte-client[82407]: System call of process 87368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:05:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] CMD "qemu-img rebase -u -b volume-30df4c45-9d5c-4469-934d-8ca139747ee5 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa" returned: 0 in 0.173s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:05:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.info" returned: 0 in 0.190s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:05:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.info" returned: 0 in 0.376s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.543s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:05:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-14f16e47-abf8-4c41-823b-f5ac3b317ea5 tempest-GroupSnapshotsV319Test-365165701 None] group_snapshot ca6e1a6f-a672-4733-8644-606620e35b45: created successfully
Sep 03 08:05:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] group_snapshot ca6e1a6f-a672-4733-8644-606620e35b45: deleting
Sep 03 08:05:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] group_snapshot ca6e1a6f-a672-4733-8644-606620e35b45: deleting {{(pid=82397) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Acquiring lock "cinder-quobyte-30df4c45-9d5c-4469-934d-8ca139747ee5" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Lock "cinder-quobyte-30df4c45-9d5c-4469-934d-8ca139747ee5" acquired by "delete_snapshot" :: waited 0.094s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Acquiring lock "cinder-quobyte-43da26b0-d6be-4722-b187-a2671d15f4aa" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Lock "cinder-quobyte-43da26b0-d6be-4722-b187-a2671d15f4aa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Deleting offline snapshot 43da26b0-d6be-4722-b187-a2671d15f4aa of volume 30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] snapshot_file for this snap is: volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec03371a-80d6-4558-8d26-89cd3f12583d]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:05:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.177s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa" returned: 0 in 0.829s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30df4c45-9d5c-4469-934d-8ca139747ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de775bb-2c8b-49c0-9d56-13083fbfaaac]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:05:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5" returned: 0 in 0.486s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa" returned: 0 in 0.235s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5.43da26b0-d6be-4722-b187-a2671d15f4aa" returned: 0 in 0.168s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Lock "cinder-quobyte-43da26b0-d6be-4722-b187-a2671d15f4aa" released by "_delete_snapshot" :: held 2.154s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Lock "cinder-quobyte-30df4c45-9d5c-4469-934d-8ca139747ee5" released by "delete_snapshot" :: held 2.193s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:50 devstack cinder-volume[82397]: WARNING cinder.quota [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1573499138 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1573499138, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:05:50 devstack cinder-volume[82397]: WARNING cinder.quota [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1573499138 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1573499138, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:05:50 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] Created reservations ['a27e1ea4-103b-41aa-a050-006f850bf678', '675b0188-5d28-4125-8804-50c7de0ac756', 'feb2ec48-3fe3-47f1-b1ba-ea9a1c62deb9', '72724b43-48f6-4e0f-9b14-d19df5ba6937'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:05:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cedbc2a0-4f93-44b7-a1ae-759ebe689e09 tempest-GroupSnapshotsV319Test-365165701 None] group_snapshot ca6e1a6f-a672-4733-8644-606620e35b45: deleted successfully
Sep 03 08:05:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:05:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Acquiring lock "cinder-quobyte-30df4c45-9d5c-4469-934d-8ca139747ee5" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:05:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Lock "cinder-quobyte-30df4c45-9d5c-4469-934d-8ca139747ee5" acquired by "delete_volume" :: waited 0.069s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:05:53 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f47ca8-a45c-4b1d-a97f-b8d83488dda1]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:05:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:54 devstack quobyte-client[82407]: System call of process 87389 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:05:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5" returned: 0 in 1.533s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30df4c45-9d5c-4469-934d-8ca139747ee5" returned: 0 in 0.296s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Lock "cinder-quobyte-30df4c45-9d5c-4469-934d-8ca139747ee5" released by "delete_volume" :: held 2.395s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:05:56 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Created reservations ['fc9aa2a9-d97c-4853-bad9-b399515bf647'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:05:57 devstack cinder-volume[82397]: WARNING cinder.quota [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1573499138 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1573499138, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Created reservations ['9459878c-3b47-4a19-a6af-5f12efdf8d10', '4ab216a8-1920-4ae1-ae85-41f9dcf67662', '5f69bd2d-4e7c-4fc2-b711-5ede50d44ed7', '696d4b5d-2351-4edf-8010-05abe2ac0f8d'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.322s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:05:57 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:05:58 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5d4fc226-e041-4148-9e8d-a75ea03d6052 tempest-GroupSnapshotsV319Test-365165701 None] Delete group completed successfully.
Sep 03 08:06:07 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=24,cinder:SELECT=23,cinder:INSERT=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:06:07 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=26,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=6 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:06:08 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-0f6569dd-08a7-4740-8c11-91c4887a86cc tempest-GroupsV320Test-671216273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:08 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-0f6569dd-08a7-4740-8c11-91c4887a86cc tempest-GroupsV320Test-671216273 None] Group tempest-GroupsV320Test-Group-791910754: creating
Sep 03 08:06:08 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-0f6569dd-08a7-4740-8c11-91c4887a86cc tempest-GroupsV320Test-671216273 None] Group tempest-GroupsV320Test-Group-791910754: created successfully
Sep 03 08:06:08 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-0f6569dd-08a7-4740-8c11-91c4887a86cc tempest-GroupsV320Test-671216273 None] Create group completed successfully.
Sep 03 08:06:12 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:12 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Created reservations ['68087ed9-a6a5-4e54-b747-a779b3dfff23'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.655s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:13 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:06:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-00dd9ce2-012c-45bd-bf36-33a6fe623874 tempest-GroupsV320Test-671216273 None] Delete group completed successfully.
Sep 03 08:06:22 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:06:23 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:06:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:32 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:06:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Flow 'volume_create_manager' (7521eb8f-7fa0-4884-af72-11f61abf6a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:06:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6fc0fe-2471-46ec-b70d-98cec2b75ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6fc0fe-2471-46ec-b70d-98cec2b75ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-192719254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fbf116-3ff6-4ee0-95e9-3bee73ab577d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a5840b1d5e429896d80abd2f656db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:06:33Z,use_quota=True,user_id='764f1cbc8d0a4be388f3e49a48bfe407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba289d94-2c97-45b3-896f-7b87b0cd16f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba289d94-2c97-45b3-896f-7b87b0cd16f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618dfa05-a0f7-4a38-b6bc-9df9c6795ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618dfa05-a0f7-4a38-b6bc-9df9c6795ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fbf116-3ff6-4ee0-95e9-3bee73ab577d', 'volume_name': 'volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c77744-91eb-434b-ae34-443852795da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c77744-91eb-434b-ae34-443852795da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495328f6-9f27-47a7-9538-d1135df6fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:33 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d', 'volume_size': 1}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-192719254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fbf116-3ff6-4ee0-95e9-3bee73ab577d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a5840b1d5e429896d80abd2f656db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:06:33Z,use_quota=True,user_id='764f1cbc8d0a4be388f3e49a48bfe407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Creating volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:06:33 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:06:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:33 devstack quobyte-client[82407]: System call of process 87649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:33 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=14, name=volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:06:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d 1073741824" returned: 0 in 1.436s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" returned: 0 in 0.543s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] <== create_volume: return (2316ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:06:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495328f6-9f27-47a7-9538-d1135df6fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c250c92-9fe6-4ab2-b876-a9b1e3a7871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:36 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Volume volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d (04fbf116-3ff6-4ee0-95e9-3bee73ab577d): created successfully
Sep 03 08:06:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c250c92-9fe6-4ab2-b876-a9b1e3a7871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Flow 'volume_create_manager' (7521eb8f-7fa0-4884-af72-11f61abf6a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:06:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8a26ef67-665e-4690-85ef-022649ba0e97 tempest-SnapshotsActionsTest-1963004476 None] Created volume successfully.
Sep 03 08:06:39 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.018s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Creating offline snapshot a98730e5-0bbf-4081-b88e-9e1b304538b3 of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:06:39 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b66f1-4370-4b05-8e0d-5294d381945b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:06:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:41 devstack quobyte-client[82407]: System call of process 87717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:41 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Flow 'volume_create_manager' (2d1e33c2-e13f-424a-8d95-87578840d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2080a4-2031-4ca3-a686-daecd96737f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" returned: 0 in 2.011s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2080a4-2031-4ca3-a686-daecd96737f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1896978113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9412079e-c4dd-42d3-a80d-2af7da5ee34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d9c02df564c76a2b111412671ac3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:06:40Z,use_quota=True,user_id='4e57dc4f63cb4bb48a89c6abecd0cc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523648e0-4aef-407e-98cb-467bb7e24515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523648e0-4aef-407e-98cb-467bb7e24515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c104488-cdd5-416a-8db6-bbadac6231c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c104488-cdd5-416a-8db6-bbadac6231c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9412079e-c4dd-42d3-a80d-2af7da5ee34b', 'volume_name': 'volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5005c5b-ed8e-418c-b4da-c52b8ad27dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5005c5b-ed8e-418c-b4da-c52b8ad27dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e8f74e-eda0-4736-8cdc-a1cd1bc28bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:41 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Volume 9412079e-c4dd-42d3-a80d-2af7da5ee34b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b', 'volume_size': 1}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:41 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=15, name=volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 1G" returned: 0 in 0.377s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:42 devstack quobyte-client[82407]: System call of process 87732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.337s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.157s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.148s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.info" returned: 0 in 0.112s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.info" returned: 0 in 0.174s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.814s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1896978113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9412079e-c4dd-42d3-a80d-2af7da5ee34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d9c02df564c76a2b111412671ac3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:06:40Z,use_quota=True,user_id='4e57dc4f63cb4bb48a89c6abecd0cc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Creating volume 9412079e-c4dd-42d3-a80d-2af7da5ee34b {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:06:43 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:06:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:43 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=17, name=volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:06:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b 1073741824" returned: 0 in 0.813s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b" returned: 0 in 0.146s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] <== create_volume: return (1084ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:06:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4aab37a6-adb6-4f96-a60e-08b52177ec81 tempest-SnapshotsActionsTest-1963004476 None] Create snapshot completed successfully
Sep 03 08:06:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e8f74e-eda0-4736-8cdc-a1cd1bc28bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28f96a-cf3d-4ecc-8ec8-44af6aa6a589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:45 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Volume volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b (9412079e-c4dd-42d3-a80d-2af7da5ee34b): created successfully
Sep 03 08:06:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28f96a-cf3d-4ecc-8ec8-44af6aa6a589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Flow 'volume_create_manager' (2d1e33c2-e13f-424a-8d95-87578840d89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:06:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-78322d0f-1c5b-4b94-9932-122abe680271 tempest-ServersNegativeTestJSON-1812418075 None] Created volume successfully.
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.849s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:06:49 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Creating offline snapshot d22a1b9d-5375-4878-b1b8-e1b51c819b1f of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:06:49 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a6be7-1d22-4e19-8795-08a13ce72cd0]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:06:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:06:50 devstack quobyte-client[82407]: System call of process 87746 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Flow 'volume_create_manager' (4c7a4b16-2d43-473e-910d-b0b343759d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ea6203-2ef6-462a-9252-729650b5ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 1.172s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ea6203-2ef6-462a-9252-729650b5ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1652272964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a6039d-aa86-4f5e-9228-673dcd84257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d9c02df564c76a2b111412671ac3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:06:50Z,use_quota=True,user_id='4e57dc4f63cb4bb48a89c6abecd0cc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d51f7e-2091-4f15-be41-08e31a5fe447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d51f7e-2091-4f15-be41-08e31a5fe447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1fc7a9-3b3d-425f-ab43-fa7a55ebe22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1fc7a9-3b3d-425f-ab43-fa7a55ebe22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a6039d-aa86-4f5e-9228-673dcd84257e', 'volume_name': 'volume-61a6039d-aa86-4f5e-9228-673dcd84257e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58dedb50-7706-4273-8b8a-9c2ba5dea212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58dedb50-7706-4273-8b8a-9c2ba5dea212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5aa6c4-dbaa-4ac9-b4d2-6c37626283f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:50 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Volume 61a6039d-aa86-4f5e-9228-673dcd84257e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a6039d-aa86-4f5e-9228-673dcd84257e', 'volume_size': 1}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:06:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:51 devstack quobyte-client[82407]: System call of process 87751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:51 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=18, name=volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:06:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f 1G" returned: 0 in 0.669s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:51 devstack quobyte-client[82407]: System call of process 87754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f" returned: 0 in 0.395s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f" returned: 0 in 0.169s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f" returned: 0 in 0.309s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.522s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.077s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1652272964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a6039d-aa86-4f5e-9228-673dcd84257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019d9c02df564c76a2b111412671ac3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:06:50Z,use_quota=True,user_id='4e57dc4f63cb4bb48a89c6abecd0cc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Creating volume 61a6039d-aa86-4f5e-9228-673dcd84257e {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:06:52 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:06:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:53 devstack quobyte-client[82407]: System call of process 87759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:53 devstack quobyte-client[82407]: System call of process 87759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:53 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=19, name=volume-61a6039d-aa86-4f5e-9228-673dcd84257e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:06:53 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b3608050-8ada-4ada-906b-b39d1170a6c4 tempest-SnapshotsActionsTest-1963004476 None] Create snapshot completed successfully
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e 1073741824" returned: 0 in 0.585s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] <== create_volume: return (722ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5aa6c4-dbaa-4ac9-b4d2-6c37626283f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a6039d-aa86-4f5e-9228-673dcd84257e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcfb8f4-7fb2-4563-94e6-db06c680d46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:06:53 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Volume volume-61a6039d-aa86-4f5e-9228-673dcd84257e (61a6039d-aa86-4f5e-9228-673dcd84257e): created successfully
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcfb8f4-7fb2-4563-94e6-db06c680d46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:06:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Flow 'volume_create_manager' (4c7a4b16-2d43-473e-910d-b0b343759d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:06:53 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-76dd2995-5616-4105-947d-57d3b2d29b41 tempest-ServersNegativeTestJSON-1812418075 None] Created volume successfully.
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-d22a1b9d-5375-4878-b1b8-e1b51c819b1f-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-d22a1b9d-5375-4878-b1b8-e1b51c819b1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:06:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-d22a1b9d-5375-4878-b1b8-e1b51c819b1f" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-d22a1b9d-5375-4878-b1b8-e1b51c819b1f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Deleting offline snapshot d22a1b9d-5375-4878-b1b8-e1b51c819b1f of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] snapshot_file for this snap is: volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb67cdc-483e-484e-ab78-828d13959e3e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f" returned: 0 in 0.539s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1b099d-2e7f-4dac-8470-c5567dde569e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:06:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "cinder-61a6039d-aa86-4f5e-9228-673dcd84257e-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-61a6039d-aa86-4f5e-9228-673dcd84257e-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.657s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "cinder-quobyte-61a6039d-aa86-4f5e-9228-673dcd84257e" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-quobyte-61a6039d-aa86-4f5e-9228-673dcd84257e" acquired by "delete_volume" :: waited 0.121s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f" returned: 0 in 0.364s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d717734-a391-4b01-8020-e3b643d72ecc]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.d22a1b9d-5375-4878-b1b8-e1b51c819b1f" returned: 0 in 0.202s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-d22a1b9d-5375-4878-b1b8-e1b51c819b1f" released by "_delete_snapshot" :: held 2.092s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" released by "delete_snapshot" :: held 2.113s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:06:56 devstack quobyte-client[82407]: System call of process 87774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:56 devstack cinder-volume[82397]: WARNING cinder.quota [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e" returned: 0 in 0.716s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61a6039d-aa86-4f5e-9228-673dcd84257e" returned: 0 in 0.184s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:56 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Created reservations ['ca79698a-cf73-428d-94cb-a1a49d46fd55', 'c6e319cc-7280-45aa-a5ba-30ded9439826', '44cafa76-a5dc-4817-a494-e68fa7040854', '5735a0bf-248d-4992-8689-450e36581c03'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-quobyte-61a6039d-aa86-4f5e-9228-673dcd84257e" released by "delete_volume" :: held 1.228s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Created reservations ['3239a540-b627-4da9-8631-425f8f0a5db6', 'cb2fe0c3-b700-4d6c-a2c5-668a68392089', '6fa7a53c-2325-4ae9-8932-07769e189e52', 'a1e343de-3be7-47c2-a521-28a8fde06331'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:06:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Delete snapshot completed successfully.
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-01082159-0245-4533-8b43-3b8d56340d06 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-d22a1b9d-5375-4878-b1b8-e1b51c819b1f-delete_snapshot" released by "delete_snapshot" :: held 3.202s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:06:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "cinder-9412079e-c4dd-42d3-a80d-2af7da5ee34b-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.844s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-9412079e-c4dd-42d3-a80d-2af7da5ee34b-delete_volume" acquired by "delete_volume" :: waited 0.373s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:06:58 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Deleted volume successfully.
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec0d254e-ecc5-45e2-8dc5-f14a7c8fc7f1 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-61a6039d-aa86-4f5e-9228-673dcd84257e-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:06:58 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "cinder-quobyte-9412079e-c4dd-42d3-a80d-2af7da5ee34b" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:06:58 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-quobyte-9412079e-c4dd-42d3-a80d-2af7da5ee34b" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f062d-8229-4f5b-a849-bc3f23613a91]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:06:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Creating offline snapshot a445c849-2d40-48c4-8e3d-cb1fba1d6d98 of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a65001-5910-478f-9cb6-134d0cc59c12]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.483s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b" returned: 0 in 0.934s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:06:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:06:59 devstack quobyte-client[82407]: System call of process 87784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:06:59 devstack quobyte-client[82407]: System call of process 87784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:00 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=20, name=volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9412079e-c4dd-42d3-a80d-2af7da5ee34b" returned: 0 in 0.183s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-quobyte-9412079e-c4dd-42d3-a80d-2af7da5ee34b" released by "delete_volume" :: held 1.330s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 1G" returned: 0 in 0.604s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:00 devstack quobyte-client[82407]: System call of process 87790 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98" returned: 0 in 0.314s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Created reservations ['7901cff1-b7b4-4386-ac63-49cddca844d3', '7ce895ef-7a4b-440e-b6b5-f4931990b429', '2bd354ef-5611-4049-9755-c8059bc4bc90', '34289da1-f8e7-4496-af3f-8702ad830038'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98" returned: 0 in 0.278s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98" returned: 0 in 0.370s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.528s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.447s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:01 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:07:02 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Deleted volume successfully.
Sep 03 08:07:02 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2f023675-4a4a-4638-8b26-9fe889d0f32d tempest-SnapshotsActionsTest-1963004476 None] Create snapshot completed successfully
Sep 03 08:07:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-efe69e62-b1e5-4158-b112-2f3700c64fc6 tempest-ServersNegativeTestJSON-1812418075 None] Lock "cinder-9412079e-c4dd-42d3-a80d-2af7da5ee34b-delete_volume" released by "delete_volume" :: held 3.758s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-a445c849-2d40-48c4-8e3d-cb1fba1d6d98-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-a445c849-2d40-48c4-8e3d-cb1fba1d6d98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:04 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" acquired by "delete_snapshot" :: waited 0.072s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-a445c849-2d40-48c4-8e3d-cb1fba1d6d98" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-a445c849-2d40-48c4-8e3d-cb1fba1d6d98" acquired by "_delete_snapshot" :: waited 0.287s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Deleting offline snapshot a445c849-2d40-48c4-8e3d-cb1fba1d6d98 of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] snapshot_file for this snap is: volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe3e06-ff08-4749-951e-0b6601da80bc]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:05 devstack quobyte-client[82407]: System call of process 87837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98" returned: 0 in 1.316s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b3211-df30-4c9f-b0b9-8139189bdd3e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 1.475s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:08 devstack quobyte-client[82407]: System call of process 87851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98" returned: 0 in 0.634s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a445c849-2d40-48c4-8e3d-cb1fba1d6d98" returned: 0 in 0.425s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-a445c849-2d40-48c4-8e3d-cb1fba1d6d98" released by "_delete_snapshot" :: held 4.790s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" released by "delete_snapshot" :: held 5.114s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:10 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Created reservations ['cd3b0f7e-5635-4598-8cb4-a9b62003a822', 'dab208e7-6b6d-4fba-86c2-00c8e1445cc3', '97a75590-d20f-408a-8b6c-9935c766e2c3', 'f583d09b-96a3-4407-961b-96699ac80cac'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:10 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Delete snapshot completed successfully.
Sep 03 08:07:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e3cc5c4f-46c3-4ee3-8acd-6380f62daefc tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-a445c849-2d40-48c4-8e3d-cb1fba1d6d98-delete_snapshot" released by "delete_snapshot" :: held 6.403s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Creating offline snapshot 3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:07:12 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[961bda25-7370-425d-9396-e5fa44ca215e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:12 devstack quobyte-client[82407]: System call of process 87862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.811s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:13 devstack quobyte-client[82407]: System call of process 87865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:13 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=21, name=volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 1G" returned: 0 in 0.428s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" returned: 0 in 0.205s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" returned: 0 in 0.107s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:07:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" returned: 0 in 0.097s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5fd8e0de-070a-454e-a8e2-eb7330f58836 tempest-SnapshotsActionsTest-1963004476 None] Create snapshot completed successfully
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-3fb2b4a8-cfdd-46c2-95de-710facb2a3a9-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-3fb2b4a8-cfdd-46c2-95de-710facb2a3a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:15 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Deleting offline snapshot 3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] snapshot_file for this snap is: volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6339b650-2c4f-45d7-8505-2ee7c3420c1b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" returned: 0 in 0.417s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0380f8cc-eb2c-4f88-bc76-e8e1ca90d0de]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.401s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:16 devstack quobyte-client[82407]: System call of process 87880 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" returned: 0 in 0.256s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-3fb2b4a8-cfdd-46c2-95de-710facb2a3a9" released by "_delete_snapshot" :: held 1.518s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" released by "delete_snapshot" :: held 1.544s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:17 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Created reservations ['44926c28-81ee-4570-9527-40ae15e65ba3', 'c5f37f44-0d7a-4b93-935a-52d924578344', '97792d8a-c003-4b6c-8104-240352f3e34c', 'b5168b44-34f2-4b06-ae58-b9bff6fcc16e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:17 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Delete snapshot completed successfully.
Sep 03 08:07:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cd8ba7ec-f74d-41a3-86d6-c0c8e639b275 tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-3fb2b4a8-cfdd-46c2-95de-710facb2a3a9-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:17 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Creating offline snapshot e7dbfc6d-da8b-46f0-bde8-c4da467dadac of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:07:17 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbdc920-778c-4369-a80a-6f10af701b51]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.514s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:18 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=22, name=volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac 1G" returned: 0 in 0.335s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img rebase -u -b volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac" returned: 0 in 0.189s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac" returned: 0 in 0.107s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac" returned: 0 in 0.129s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.559s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:19 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f631a31b-fffe-4839-ae1c-b155f6b39fc0 tempest-SnapshotsActionsTest-1963004476 None] Create snapshot completed successfully
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-e7dbfc6d-da8b-46f0-bde8-c4da467dadac-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-e7dbfc6d-da8b-46f0-bde8-c4da467dadac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.122s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:20 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Acquiring lock "cinder-quobyte-e7dbfc6d-da8b-46f0-bde8-c4da467dadac" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-e7dbfc6d-da8b-46f0-bde8-c4da467dadac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Deleting offline snapshot e7dbfc6d-da8b-46f0-bde8-c4da467dadac of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] snapshot_file for this snap is: volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[63788613-d11a-4295-8bf2-a98411581f0b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:21 devstack quobyte-client[82407]: System call of process 87924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac" returned: 0 in 0.516s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:21 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13ca696-c0de-4b64-b98c-56c54cef00d4]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.629s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:22 devstack quobyte-client[82407]: System call of process 87930 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac" returned: 0 in 0.688s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.e7dbfc6d-da8b-46f0-bde8-c4da467dadac" returned: 0 in 0.229s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-e7dbfc6d-da8b-46f0-bde8-c4da467dadac" released by "_delete_snapshot" :: held 2.470s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" released by "delete_snapshot" :: held 2.517s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:23 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=42,cinder:SELECT=34,cinder:DELETE=3,cinder:INSERT=7 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:07:23 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=37,cinder:UPDATE=46,cinder:DELETE=7,cinder:INSERT=13 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:07:23 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Created reservations ['454e7955-14d0-47ad-ae4f-2d173d9b9c81', '70f25329-d86d-4486-be59-b9f4de935596', '67b66c1d-28c6-407d-bb98-3f017f9bf05e', 'f77eff6f-9211-4b1b-8fb5-4265cdcc9b7b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:23 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Delete snapshot completed successfully.
Sep 03 08:07:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1aad1da1-7d8d-421a-9ead-69c5b4a6e3ce tempest-SnapshotsActionsTest-2038726600 None] Lock "cinder-e7dbfc6d-da8b-46f0-bde8-c4da467dadac-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "cinder-a98730e5-0bbf-4081-b88e-9e1b304538b3-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-a98730e5-0bbf-4081-b88e-9e1b304538b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "cinder-quobyte-a98730e5-0bbf-4081-b88e-9e1b304538b3" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-quobyte-a98730e5-0bbf-4081-b88e-9e1b304538b3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Deleting offline snapshot a98730e5-0bbf-4081-b88e-9e1b304538b3 of volume 04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] snapshot_file for this snap is: volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56893e1-edcb-4fa9-b0cd-5b14811df13e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.567s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:26 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a386ca-72ca-4a1e-9bd6-0226335ae835]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" returned: 0 in 0.581s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.282s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d.a98730e5-0bbf-4081-b88e-9e1b304538b3" returned: 0 in 0.151s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-quobyte-a98730e5-0bbf-4081-b88e-9e1b304538b3" released by "_delete_snapshot" :: held 1.900s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" released by "delete_snapshot" :: held 1.937s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:27 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Created reservations ['5b4f34e0-8864-44f4-a735-f0d1f6ca55e7', '9f336e6d-4eea-42f4-b58b-85f80ff7de19', '5be576a7-a598-4af1-8cbe-6e88f67f2b6f', 'a21edfc7-44a2-4337-885d-a5384ba09e34'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:28 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Delete snapshot completed successfully.
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d7bb2ca9-d36e-4897-9a70-6eee1ae11e83 tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-a98730e5-0bbf-4081-b88e-9e1b304538b3-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Flow 'volume_create_manager' (e0c09f35-61b9-48b7-ae4f-05fea74dc51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddef43f-c9d9-48bc-ad3e-f0e58962cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddef43f-c9d9-48bc-ad3e-f0e58962cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2120065616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9b1ee1-ed0e-410b-9a3a-65f12949283b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c5b0455b1498d8c528062d07259d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:28Z,use_quota=True,user_id='ed4896c52cb441d1b808ec1f2933d60e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af005570-56dd-4cf2-986a-b6bd48cb7926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af005570-56dd-4cf2-986a-b6bd48cb7926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8dc9e-0ca4-4930-ba81-3277681503db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8dc9e-0ca4-4930-ba81-3277681503db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9b1ee1-ed0e-410b-9a3a-65f12949283b', 'volume_name': 'volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dd53f4-f07f-4b69-b5e1-e3d81aa40a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dd53f4-f07f-4b69-b5e1-e3d81aa40a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c19557-c5b9-456e-ba81-aa5ef707ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:28 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Volume 2e9b1ee1-ed0e-410b-9a3a-65f12949283b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b', 'volume_size': 1}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2120065616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9b1ee1-ed0e-410b-9a3a-65f12949283b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c5b0455b1498d8c528062d07259d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:28Z,use_quota=True,user_id='ed4896c52cb441d1b808ec1f2933d60e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Creating volume 2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:07:28 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:28 devstack quobyte-client[82407]: System call of process 87978 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:28 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=23, name=volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b 1073741824" returned: 0 in 0.371s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] <== create_volume: return (590ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.603s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "cinder-04fbf116-3ff6-4ee0-95e9-3bee73ab577d-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c19557-c5b9-456e-ba81-aa5ef707ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eb9c7d-be7a-434e-a0c7-7a6225c86572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-04fbf116-3ff6-4ee0-95e9-3bee73ab577d-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:29 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Volume volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b (2e9b1ee1-ed0e-410b-9a3a-65f12949283b): created successfully
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eb9c7d-be7a-434e-a0c7-7a6225c86572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Flow 'volume_create_manager' (e0c09f35-61b9-48b7-ae4f-05fea74dc51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-ba2bbed7-18b2-446d-bfa1-87529fd6d1ad req-9b24515a-2447-4c07-b8ba-c790e0097d95 tempest-VolumesSnapshotsTestJSON-1254577991 None] Created volume successfully.
Sep 03 08:07:29 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" acquired by "delete_volume" :: waited 0.025s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9aae96-a48c-477a-b85f-ed3d51c0afd7]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" returned: 0 in 0.376s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" returned: 0 in 0.077s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-quobyte-04fbf116-3ff6-4ee0-95e9-3bee73ab577d" released by "delete_volume" :: held 0.594s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Created reservations ['ccb0b397-903d-4c70-87a4-9015d2ee3666', 'd8dcf473-3c6f-4e73-90ad-b26803d739f6', '9e5f5946-7778-4040-acda-4ad0477909cf', '293a1d46-af01-49eb-8ad9-aacbb127c2c8'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.091s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:30 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:07:30 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Deleted volume successfully.
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0e545842-66ee-48b8-8e9f-a9f02ee4d12c tempest-SnapshotsActionsTest-1963004476 None] Lock "cinder-04fbf116-3ff6-4ee0-95e9-3bee73ab577d-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:31 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Creating offline snapshot b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 of volume 2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfa1ed2-8208-4506-9c40-70b4fbbd59a2]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" returned: 0 in 0.442s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:31 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=24, name=volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 1G" returned: 0 in 0.281s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "qemu-img rebase -u -b volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" returned: 0 in 0.177s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" returned: 0 in 0.129s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" returned: 0 in 0.106s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.info" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.info" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.677s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-03d25b36-28d9-4ffc-8d6f-136f281863e3 req-1175fdc0-3e70-4d44-8382-17fcf318b8be tempest-VolumesSnapshotsTestJSON-1254577991 None] Create snapshot completed successfully
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "cinder-b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "cinder-quobyte-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-quobyte-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "cinder-quobyte-b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-quobyte-b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Deleting offline snapshot b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 of volume 2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] snapshot_file for this snap is: volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0277d4f4-960c-4dff-8fd6-af2d1b02002a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" returned: 0 in 0.440s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8142ef-5ccd-48fa-bead-da9011db6be3]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" returned: 0 in 0.420s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" returned: 0 in 0.238s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b.b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" returned: 0 in 0.098s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-quobyte-b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8" released by "_delete_snapshot" :: held 1.502s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-quobyte-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" released by "delete_snapshot" :: held 1.528s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:35 devstack cinder-volume[82397]: DEBUG cinder.quota [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Created reservations ['c3bd5b46-7376-46d1-9887-1a6421b849aa', 'b72970f0-63d1-4838-8f25-042ff77ce131', '6e23cd10-7fe9-4c5a-83c3-c53eb6e453d6', '4f243b7a-2595-453c-92dc-463ee93e40a1'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:35 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Delete snapshot completed successfully.
Sep 03 08:07:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-b7e42f85-c8bc-4a81-8913-7a4b676c1ca9 req-e9728773-9548-43f2-8732-3edf81dfedde tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-b7311d4b-ce04-4d21-9da0-46e9a2ba9bf8-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "cinder-2e9b1ee1-ed0e-410b-9a3a-65f12949283b-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-2e9b1ee1-ed0e-410b-9a3a-65f12949283b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:35 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "cinder-quobyte-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-quobyte-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:36 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4655233-2cc7-477f-82cc-42d27355c001]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" returned: 0 in 0.442s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" returned: 0 in 0.128s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-quobyte-2e9b1ee1-ed0e-410b-9a3a-65f12949283b" released by "delete_volume" :: held 0.762s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG cinder.quota [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Created reservations ['46873618-79cf-43d3-ade9-f83095bed84b', '23029845-b0c3-4f7b-8d68-799be5376d9c', 'b1d0aba4-a796-4ff9-b62b-a6e8564cc1aa', '161fa108-b4b1-4af3-b449-24cb3d21e445'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.130s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG cinder.manager [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:07:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Deleted volume successfully.
Sep 03 08:07:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-48bf64f7-42c9-406a-82c1-43d9d035f1ee req-48f5139f-2d6f-45a8-a848-a26295c0f3c5 tempest-VolumesSnapshotsTestJSON-1254577991 None] Lock "cinder-2e9b1ee1-ed0e-410b-9a3a-65f12949283b-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:44 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4c827807-fc28-4c78-a721-1552c95c5cd4 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4c827807-fc28-4c78-a721-1552c95c5cd4 tempest-GroupSnapshotsTest-1687054607 None] Group tempest-GroupSnapshotsTest-Group-1570062535: creating
Sep 03 08:07:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4c827807-fc28-4c78-a721-1552c95c5cd4 tempest-GroupSnapshotsTest-1687054607 None] Group tempest-GroupSnapshotsTest-Group-1570062535: created successfully
Sep 03 08:07:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4c827807-fc28-4c78-a721-1552c95c5cd4 tempest-GroupSnapshotsTest-1687054607 None] Create group completed successfully.
Sep 03 08:07:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Flow 'volume_create_manager' (830208e9-41d6-4b9a-ac16-28d9d76ee4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee41461-5a08-41c6-8a4c-835ce8436379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee41461-5a08-41c6-8a4c-835ce8436379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-865523549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd19965-5f2b-4897-a159-6d574b67b62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf894bdb38e4e369deb12eaf3e54b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:45Z,use_quota=True,user_id='37797f221027453aa938a51a5fa3ff4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a249dce-2644-446b-864d-089fc292693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a249dce-2644-446b-864d-089fc292693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b571692-28a0-4be5-ba68-22d085919772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b571692-28a0-4be5-ba68-22d085919772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd19965-5f2b-4897-a159-6d574b67b62d', 'volume_name': 'volume-dbd19965-5f2b-4897-a159-6d574b67b62d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd5d700-a1c9-428f-ba5f-63397d0f0e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd5d700-a1c9-428f-ba5f-63397d0f0e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc36a12-277b-4971-b751-e4dd5d917fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:45 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Volume dbd19965-5f2b-4897-a159-6d574b67b62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd19965-5f2b-4897-a159-6d574b67b62d', 'volume_size': 1}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-865523549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd19965-5f2b-4897-a159-6d574b67b62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf894bdb38e4e369deb12eaf3e54b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:45Z,use_quota=True,user_id='37797f221027453aa938a51a5fa3ff4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Creating volume dbd19965-5f2b-4897-a159-6d574b67b62d {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:07:45 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:07:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:45 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=26, name=volume-dbd19965-5f2b-4897-a159-6d574b67b62d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d 1073741824" returned: 0 in 0.715s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d" returned: 0 in 0.194s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] <== create_volume: return (971ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (d7d97865-7879-4ff7-9b49-c59e4d818c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b66f49-3ae6-48b7-a1f8-f0d485095f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc36a12-277b-4971-b751-e4dd5d917fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd19965-5f2b-4897-a159-6d574b67b62d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3670824-d479-4d9e-a839-365e226cc242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b66f49-3ae6-48b7-a1f8-f0d485095f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851162712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ba46311a-f955-4c97-8e3e-e370f2d26752,host='devstack@QuobyteHD#QuobyteHD',id=a0ed6a2a-c212-4112-a707-0e98c22ac32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:46Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22f90fa3-02b7-4024-b9a5-16c7d8695d7c),volume_type_id=22f90fa3-02b7-4024-b9a5-16c7d8695d7c)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bd116c-fd88-437a-8460-de629e029786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bd116c-fd88-437a-8460-de629e029786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e82adb-1c8c-4e45-92f8-1475cf5035e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e82adb-1c8c-4e45-92f8-1475cf5035e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ed6a2a-c212-4112-a707-0e98c22ac32a', 'volume_name': 'volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc907b9-fb24-41da-9488-ef55ce111818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc907b9-fb24-41da-9488-ef55ce111818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6827a5-af1a-4d23-a95e-c6ae285c8e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:46 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Volume a0ed6a2a-c212-4112-a707-0e98c22ac32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a', 'volume_size': 1}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ba46311a-f955-4c97-8e3e-e370f2d26752,created_at=2025-09-03T06:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851162712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ba46311a-f955-4c97-8e3e-e370f2d26752,host='devstack@QuobyteHD#QuobyteHD',id=a0ed6a2a-c212-4112-a707-0e98c22ac32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:46Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22f90fa3-02b7-4024-b9a5-16c7d8695d7c),volume_type_id=22f90fa3-02b7-4024-b9a5-16c7d8695d7c)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Creating volume a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:07:46 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:46 devstack quobyte-client[82407]: System call of process 88043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:46 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Volume volume-dbd19965-5f2b-4897-a159-6d574b67b62d (dbd19965-5f2b-4897-a159-6d574b67b62d): created successfully
Sep 03 08:07:46 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=27, name=volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3670824-d479-4d9e-a839-365e226cc242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Flow 'volume_create_manager' (830208e9-41d6-4b9a-ac16-28d9d76ee4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-64c91785-54dc-4411-a3d5-701e087e2c81 tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Created volume successfully.
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a 1073741824" returned: 0 in 0.520s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a" returned: 0 in 0.157s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] <== create_volume: return (744ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6827a5-af1a-4d23-a95e-c6ae285c8e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed1d907-8cf2-4bed-b1d5-29e839406c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:47 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Volume volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a (a0ed6a2a-c212-4112-a707-0e98c22ac32a): created successfully
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed1d907-8cf2-4bed-b1d5-29e839406c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (d7d97865-7879-4ff7-9b49-c59e4d818c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-9166f115-1286-4ad1-a088-70be55a9685c tempest-GroupSnapshotsTest-1687054607 None] Created volume successfully.
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.152s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:07:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] GroupSnapshot c413a7b7-1913-470f-81bc-706855197906: creating.
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Acquiring lock "cinder-dbd19965-5f2b-4897-a159-6d574b67b62d-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "cinder-dbd19965-5f2b-4897-a159-6d574b67b62d-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:49 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Group snapshot c413a7b7-1913-470f-81bc-706855197906: creating. {{(pid=82397) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Creating offline snapshot c6f7ac34-329b-4ff0-97f0-cf263e938d5b of volume a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:07:49 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Acquiring lock "cinder-quobyte-dbd19965-5f2b-4897-a159-6d574b67b62d" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c67a4-81e1-4823-9b4e-7f65a7659bc6]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "cinder-quobyte-dbd19965-5f2b-4897-a159-6d574b67b62d" acquired by "delete_volume" :: waited 0.223s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b59710-7faf-4c30-a83d-28c593a51234]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a" returned: 0 in 0.561s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d" returned: 0 in 0.546s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:50 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=28, name=volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b 1G" returned: 0 in 0.376s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbd19965-5f2b-4897-a159-6d574b67b62d" returned: 0 in 0.237s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:50 devstack quobyte-client[82407]: System call of process 88058 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "cinder-quobyte-dbd19965-5f2b-4897-a159-6d574b67b62d" released by "delete_volume" :: held 1.016s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img rebase -u -b volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b" returned: 0 in 0.348s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b" returned: 0 in 0.263s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:07:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b" returned: 0 in 0.311s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Created reservations ['fbc77443-67e4-45f7-9289-03e836da10e2', '2fcf6c8c-447b-4d79-a8b3-d1761e60bb87', 'b8df0ca2-5f27-4bd4-aef4-61ef3aae3fe9', '52b7ec75-10a0-4940-b1d8-688a8fbc477b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.info" returned: 0 in 0.337s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.info" returned: 0 in 0.221s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.708s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5b5354b6-87af-4037-acea-147ff5cc8280 tempest-GroupSnapshotsTest-1687054607 None] group_snapshot c413a7b7-1913-470f-81bc-706855197906: created successfully
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.381s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:07:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Deleted volume successfully.
Sep 03 08:07:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5af3db78-5a85-4410-b6ca-d43f4143ee5c tempest-VolumeQuotasNegativeTestJSON-1843329699 None] Lock "cinder-dbd19965-5f2b-4897-a159-6d574b67b62d-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:07:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Flow 'volume_create_manager' (ce1a9bcc-f594-4d8b-afef-ab92f96d8757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac73c04-db8e-4852-97c1-26395de5211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac73c04-db8e-4852-97c1-26395de5211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-966651093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b80e06-dc35-4b8c-a158-396f3a869bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfcac6480f94a8c9b80ebf3269cc0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:54Z,use_quota=True,user_id='ab29d9cdfeb5426ba3203394efc74aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ccc9fc-5d10-4e9a-a9a2-dcdb1c17aef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ccc9fc-5d10-4e9a-a9a2-dcdb1c17aef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3f7f60-f04f-435e-8a32-09ba78b2e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3f7f60-f04f-435e-8a32-09ba78b2e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b80e06-dc35-4b8c-a158-396f3a869bc4', 'volume_name': 'volume-18b80e06-dc35-4b8c-a158-396f3a869bc4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a6a56b-7b5b-45fa-93c2-e233228a45b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a6a56b-7b5b-45fa-93c2-e233228a45b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1b971d-7533-4d43-8293-5931dd4a15ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:54 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume 18b80e06-dc35-4b8c-a158-396f3a869bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b80e06-dc35-4b8c-a158-396f3a869bc4', 'volume_size': 1}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-966651093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b80e06-dc35-4b8c-a158-396f3a869bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfcac6480f94a8c9b80ebf3269cc0b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:07:54Z,use_quota=True,user_id='ab29d9cdfeb5426ba3203394efc74aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Creating volume 18b80e06-dc35-4b8c-a158-396f3a869bc4 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:07:54 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:54 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=30, name=volume-18b80e06-dc35-4b8c-a158-396f3a869bc4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4 1073741824" returned: 0 in 0.506s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4" returned: 0 in 0.134s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] <== create_volume: return (767ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1b971d-7533-4d43-8293-5931dd4a15ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b80e06-dc35-4b8c-a158-396f3a869bc4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46781e7-b2be-4f7a-9fd0-457864dcd588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:07:55 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume volume-18b80e06-dc35-4b8c-a158-396f3a869bc4 (18b80e06-dc35-4b8c-a158-396f3a869bc4): created successfully
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46781e7-b2be-4f7a-9fd0-457864dcd588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Flow 'volume_create_manager' (ce1a9bcc-f594-4d8b-afef-ab92f96d8757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:07:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-c6f7ac34-329b-4ff0-97f0-cf263e938d5b-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" by "_create_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:55 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-538f4151-7db3-43a1-9289-d722c6952f57 tempest-AttachVolumeShelveTestJSON-1388624222 None] Created volume successfully.
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-c6f7ac34-329b-4ff0-97f0-cf263e938d5b-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Creating volume 8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 from snapshot c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" by "_copy_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] snapshot: c6f7ac34-329b-4ff0-97f0-cf263e938d5b, volume: 8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8,  {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[181958eb-ec4f-45ed-b9ac-8095fc37a307]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b" returned: 0 in 0.588s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Creating direct copy from snapshot {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ba5dc-ed72-40df-9890-7a5b0c86c825]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:07:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a" returned: 0 in 0.740s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:07:57 devstack cinder-volume[82397]: DEBUG cinder.utils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 not found in is_blk_device check {{(pid=82397) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 03 08:07:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:07:57 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=31, name=volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:06 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=50,cinder:INSERT=19,cinder:UPDATE=48,cinder:DELETE=6 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:08:06 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=56,cinder:SELECT=34,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:08:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" returned: 0 in 10.308s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:08 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[4772a84b-d9ed-428c-930c-57dc73b055b3]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a" returned: 0 in 1.578s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:09 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:08:09 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Converted 1024.00 MB image at 99.21 MB/s
Sep 03 08:08:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:08:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:10 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Flow 'volume_create_manager' (5025a7b2-fd12-4412-a454-cbca6827c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415270fe-c383-4d63-b43e-7a4b6a28b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415270fe-c383-4d63-b43e-7a4b6a28b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-760212807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5839d21f-5552-475a-a5cf-dbc995d43b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9f40a0a834093913f6884c8c26c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:09Z,use_quota=True,user_id='395010c22d754106beb67914c326faee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd596a54-9d25-4f8f-9a17-24a09423b44d),volume_type_id=fd596a54-9d25-4f8f-9a17-24a09423b44d)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abbf28-1982-4c80-b7d7-0894703d85a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abbf28-1982-4c80-b7d7-0894703d85a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e887f75-ba87-439e-92f5-290c769bd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e887f75-ba87-439e-92f5-290c769bd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5839d21f-5552-475a-a5cf-dbc995d43b2b', 'volume_name': 'volume-5839d21f-5552-475a-a5cf-dbc995d43b2b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b74b92-2b23-49b3-9998-471760400311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b74b92-2b23-49b3-9998-471760400311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de00c8a5-6c65-4cd1-83e5-1bfd46cacf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:10 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Volume 5839d21f-5552-475a-a5cf-dbc995d43b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5839d21f-5552-475a-a5cf-dbc995d43b2b', 'volume_size': 1}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" returned: 0 in 0.973s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" released by "_copy_volume_from_snapshot" :: held 14.691s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-c6f7ac34-329b-4ff0-97f0-cf263e938d5b-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" released by "_create_volume_from_snapshot" :: held 14.734s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.813s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-760212807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5839d21f-5552-475a-a5cf-dbc995d43b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9f40a0a834093913f6884c8c26c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:09Z,use_quota=True,user_id='395010c22d754106beb67914c326faee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd596a54-9d25-4f8f-9a17-24a09423b44d),volume_type_id=fd596a54-9d25-4f8f-9a17-24a09423b44d)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Creating volume 5839d21f-5552-475a-a5cf-dbc995d43b2b {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:08:10 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:08:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:10 devstack quobyte-client[82407]: System call of process 88169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:10 devstack quobyte-client[82407]: System call of process 88169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:11 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=32, name=volume-5839d21f-5552-475a-a5cf-dbc995d43b2b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b 1073741824" returned: 0 in 0.787s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b" returned: 0 in 0.225s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] <== create_volume: return (1078ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:08:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de00c8a5-6c65-4cd1-83e5-1bfd46cacf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5839d21f-5552-475a-a5cf-dbc995d43b2b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25360103-8f6f-47a8-bbb3-02d91c9e947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:12 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Volume volume-5839d21f-5552-475a-a5cf-dbc995d43b2b (5839d21f-5552-475a-a5cf-dbc995d43b2b): created successfully
Sep 03 08:08:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25360103-8f6f-47a8-bbb3-02d91c9e947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Flow 'volume_create_manager' (5025a7b2-fd12-4412-a454-cbca6827c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-dabd8d54-bd5d-40ab-b080-160835e09bcd tempest-GroupSnapshotsTest-1687054607 None] Create group from source-snapshot-c413a7b7-1913-470f-81bc-706855197906 completed successfully.
Sep 03 08:08:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3182ab53-b20a-45f1-a548-b6800528fd4c tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Created volume successfully.
Sep 03 08:08:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" acquired by "delete_volume" :: waited 0.080s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:13 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd077d7f-3135-468d-8a58-4f93291064c4]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:14 devstack quobyte-client[82407]: System call of process 88173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" returned: 0 in 0.709s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" returned: 0 in 0.293s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-8d2b1d1e-bdd0-4300-99b6-65fb5fb3a5d8" released by "delete_volume" :: held 1.261s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Acquiring lock "cinder-5839d21f-5552-475a-a5cf-dbc995d43b2b-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.499s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "cinder-5839d21f-5552-475a-a5cf-dbc995d43b2b-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:15 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-40fae26d-43a5-461c-a702-4c2cd26f0872 tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Retype volume completed successfully.
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['ba0833ac-4558-43f7-b80f-fe89f436b4c4'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:15 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Acquiring lock "cinder-quobyte-5839d21f-5552-475a-a5cf-dbc995d43b2b" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:15 devstack cinder-volume[82397]: WARNING cinder.quota [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-888110550 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-888110550, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:15 devstack cinder-volume[82397]: WARNING cinder.quota [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-888110550 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-888110550, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "cinder-quobyte-5839d21f-5552-475a-a5cf-dbc995d43b2b" acquired by "delete_volume" :: waited 0.036s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['0524c8e3-d937-4fd8-8992-beccb69098f8', 'aa1cfa48-353d-4d16-a19f-9f5876eeafcd', '2af80168-fb74-4909-a867-824dcd44c92f', '96564315-85d0-4bfb-8828-7ef936a713bf'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba731dfd-f65a-467b-99c9-b44ec1478e42]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:16 devstack quobyte-client[82407]: System call of process 88178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b" returned: 0 in 0.838s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5839d21f-5552-475a-a5cf-dbc995d43b2b" returned: 0 in 0.287s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "cinder-quobyte-5839d21f-5552-475a-a5cf-dbc995d43b2b" released by "delete_volume" :: held 1.386s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.299s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:08:17 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7e277641-4406-414b-a301-cd2ba56da794 tempest-GroupSnapshotsTest-1687054607 None] Delete group completed successfully.
Sep 03 08:08:17 devstack cinder-volume[82397]: WARNING cinder.quota [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:17 devstack cinder-volume[82397]: WARNING cinder.quota [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Created reservations ['5578b477-a3dc-4bb6-89c0-3384d3232115', '0f6b7bf8-3572-469c-9293-2f3e44025fbd', '5989cd54-f13d-4534-bb52-981c007a8db6', '55621962-dc84-478d-9272-5742ab0db70b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.101s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:17 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:08:17 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Deleted volume successfully.
Sep 03 08:08:18 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] group_snapshot c413a7b7-1913-470f-81bc-706855197906: deleting
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-445e9607-8ecc-49a9-ba0b-3f578a64e55f tempest-VolumeRetypeWithoutMigrationTest-558030818 None] Lock "cinder-5839d21f-5552-475a-a5cf-dbc995d43b2b-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:18 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] group_snapshot c413a7b7-1913-470f-81bc-706855197906: deleting {{(pid=82397) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-a0ed6a2a-c212-4112-a707-0e98c22ac32a" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-a0ed6a2a-c212-4112-a707-0e98c22ac32a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-c6f7ac34-329b-4ff0-97f0-cf263e938d5b" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-c6f7ac34-329b-4ff0-97f0-cf263e938d5b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Deleting offline snapshot c6f7ac34-329b-4ff0-97f0-cf263e938d5b of volume a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] snapshot_file for this snap is: volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a0201a-b3b0-42b3-b7fe-7546d5512734]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:18 devstack quobyte-client[82407]: System call of process 88186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b" returned: 0 in 0.498s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c38f4ea-1592-43bf-889b-6e5f1d1e9c95]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:19 devstack quobyte-client[82407]: System call of process 88189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a" returned: 0 in 0.464s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:19 devstack quobyte-client[82407]: System call of process 88192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b" returned: 0 in 0.333s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a.c6f7ac34-329b-4ff0-97f0-cf263e938d5b" returned: 0 in 0.102s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-c6f7ac34-329b-4ff0-97f0-cf263e938d5b" released by "_delete_snapshot" :: held 1.731s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-a0ed6a2a-c212-4112-a707-0e98c22ac32a" released by "delete_snapshot" :: held 1.757s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:20 devstack cinder-volume[82397]: WARNING cinder.quota [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-888110550 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-888110550, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:20 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['c05bb51d-7496-450c-beb7-612aea62d313', '8ef1ea04-a226-4bcf-8aed-96fa32a905eb', 'da94d2a2-f156-44d5-ac6a-bd1a332b31ae', '6c3fddb2-398f-4135-a8fa-18775048aad1'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-21835b35-49c9-4396-9df9-7177f02e22cc tempest-GroupSnapshotsTest-1687054607 None] group_snapshot c413a7b7-1913-470f-81bc-706855197906: deleted successfully
Sep 03 08:08:21 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:22 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-a0ed6a2a-c212-4112-a707-0e98c22ac32a" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:22 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-a0ed6a2a-c212-4112-a707-0e98c22ac32a" acquired by "delete_volume" :: waited 0.022s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:22 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d54928a-0103-41f9-b690-4c1a18eed578]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:22 devstack quobyte-client[82407]: System call of process 88198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a" returned: 0 in 0.584s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a0ed6a2a-c212-4112-a707-0e98c22ac32a" returned: 0 in 0.209s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-a0ed6a2a-c212-4112-a707-0e98c22ac32a" released by "delete_volume" :: held 0.966s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['9d76ebde-fbff-4f45-b770-b410ab420ebb'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:23 devstack cinder-volume[82397]: WARNING cinder.db.sqlalchemy.api [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-888110550']
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['b5e18d93-657b-4b90-a18c-2182812d8dbd', 'c8e83aac-6609-441d-b646-e2c6a4612607', 'c18d4bac-3cac-4fa1-a185-87a9b08e8654', '31c205e6-1cd7-478f-bbc1-78e7386fd403'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.119s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:24 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:08:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ebbe70bc-1033-4e90-b586-047ca8834387 tempest-GroupSnapshotsTest-1687054607 None] Delete group completed successfully.
Sep 03 08:08:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-1c78572f-b8c9-4b6c-a67d-7412f47a18f3 req-ad291d03-458b-4134-9b7a-0b2cb9eae247 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-04c50712-56a3-4dd5-8269-1efeec01d6a7 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-04c50712-56a3-4dd5-8269-1efeec01d6a7 tempest-GroupSnapshotsTest-1687054607 None] Group tempest-GroupSnapshotsTest-Group-361823586: creating
Sep 03 08:08:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-1c78572f-b8c9-4b6c-a67d-7412f47a18f3 req-ad291d03-458b-4134-9b7a-0b2cb9eae247 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-1c78572f-b8c9-4b6c-a67d-7412f47a18f3 req-ad291d03-458b-4134-9b7a-0b2cb9eae247 tempest-AttachVolumeShelveTestJSON-1388624222 None] No connector for attachment 9fd48524-099a-4426-9272-9131811f8fbe; skipping storage backend terminate_connection call. {{(pid=82397) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 03 08:08:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-1c78572f-b8c9-4b6c-a67d-7412f47a18f3 req-ad291d03-458b-4134-9b7a-0b2cb9eae247 tempest-AttachVolumeShelveTestJSON-1388624222 None] Deleting attachment 9fd48524-099a-4426-9272-9131811f8fbe. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:08:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-04c50712-56a3-4dd5-8269-1efeec01d6a7 tempest-GroupSnapshotsTest-1687054607 None] Group tempest-GroupSnapshotsTest-Group-361823586: created successfully
Sep 03 08:08:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-04c50712-56a3-4dd5-8269-1efeec01d6a7 tempest-GroupSnapshotsTest-1687054607 None] Create group completed successfully.
Sep 03 08:08:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (9e8c88c9-5bc3-4c13-9b03-b4084d395c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e844037f-c34a-4596-881d-9219bf5a5e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e844037f-c34a-4596-881d-9219bf5a5e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1660236680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b43efcc1-7b32-4860-9ab4-c1e08bf3e721,host='devstack@QuobyteHD#QuobyteHD',id=61cf89b7-7371-4c38-bff2-259ad8a1ac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:27Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b602493c-2bce-4ac6-9e57-11834595bdfb),volume_type_id=b602493c-2bce-4ac6-9e57-11834595bdfb)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12997d89-047d-4c1c-a3ca-1d116695cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12997d89-047d-4c1c-a3ca-1d116695cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1442cd-8e2e-4635-8c07-7ac9c311c0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1442cd-8e2e-4635-8c07-7ac9c311c0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cf89b7-7371-4c38-bff2-259ad8a1ac3c', 'volume_name': 'volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bfc6fa-60cd-4380-adef-5c7245862384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bfc6fa-60cd-4380-adef-5c7245862384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1499e1-2187-4ccd-9567-a22451e23d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:27 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Volume 61cf89b7-7371-4c38-bff2-259ad8a1ac3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c', 'volume_size': 1}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b43efcc1-7b32-4860-9ab4-c1e08bf3e721,created_at=2025-09-03T06:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1660236680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b43efcc1-7b32-4860-9ab4-c1e08bf3e721,host='devstack@QuobyteHD#QuobyteHD',id=61cf89b7-7371-4c38-bff2-259ad8a1ac3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:27Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b602493c-2bce-4ac6-9e57-11834595bdfb),volume_type_id=b602493c-2bce-4ac6-9e57-11834595bdfb)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Creating volume 61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:08:27 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:27 devstack quobyte-client[82407]: System call of process 88236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:27 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=33, name=volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c 1073741824" returned: 0 in 0.466s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" returned: 0 in 0.113s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] <== create_volume: return (701ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:08:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1499e1-2187-4ccd-9567-a22451e23d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30ffae4-b319-495b-8c72-a071bde4f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:28 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Volume volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c (61cf89b7-7371-4c38-bff2-259ad8a1ac3c): created successfully
Sep 03 08:08:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30ffae4-b319-495b-8c72-a071bde4f849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (9e8c88c9-5bc3-4c13-9b03-b4084d395c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:28 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3b96fbc4-ca24-4166-a2ee-60a4b897285f tempest-GroupSnapshotsTest-1687054607 None] Created volume successfully.
Sep 03 08:08:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (218ab221-7af4-4b21-ae5c-56626d8dafb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00b2142-d77a-421e-a234-e1695c0c6e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00b2142-d77a-421e-a234-e1695c0c6e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-332360135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b43efcc1-7b32-4860-9ab4-c1e08bf3e721,host='devstack@QuobyteHD#QuobyteHD',id=0269d915-e562-41c0-8db0-316f4c8119a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:30Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b602493c-2bce-4ac6-9e57-11834595bdfb),volume_type_id=b602493c-2bce-4ac6-9e57-11834595bdfb)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdffdef-b06d-467b-bb14-535f439d4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdffdef-b06d-467b-bb14-535f439d4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9ec528-bc1e-48e7-bc2d-d1dea2885697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9ec528-bc1e-48e7-bc2d-d1dea2885697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0269d915-e562-41c0-8db0-316f4c8119a7', 'volume_name': 'volume-0269d915-e562-41c0-8db0-316f4c8119a7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccd411a-11d0-4005-b893-6487ae762c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccd411a-11d0-4005-b893-6487ae762c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517657c2-495b-4cf8-bf1a-6bc31232c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:30 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Volume 0269d915-e562-41c0-8db0-316f4c8119a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0269d915-e562-41c0-8db0-316f4c8119a7', 'volume_size': 1}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b43efcc1-7b32-4860-9ab4-c1e08bf3e721,created_at=2025-09-03T06:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-332360135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b43efcc1-7b32-4860-9ab4-c1e08bf3e721,host='devstack@QuobyteHD#QuobyteHD',id=0269d915-e562-41c0-8db0-316f4c8119a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:30Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b602493c-2bce-4ac6-9e57-11834595bdfb),volume_type_id=b602493c-2bce-4ac6-9e57-11834595bdfb)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Creating volume 0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:08:30 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:30 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=34, name=volume-0269d915-e562-41c0-8db0-316f4c8119a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 1073741824" returned: 0 in 0.355s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7" returned: 0 in 0.142s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] <== create_volume: return (571ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:08:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.585s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517657c2-495b-4cf8-bf1a-6bc31232c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0269d915-e562-41c0-8db0-316f4c8119a7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8408ec-b06b-415f-bf9b-3fc9c6c6bdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Volume volume-0269d915-e562-41c0-8db0-316f4c8119a7 (0269d915-e562-41c0-8db0-316f4c8119a7): created successfully
Sep 03 08:08:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8408ec-b06b-415f-bf9b-3fc9c6c6bdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (218ab221-7af4-4b21-ae5c-56626d8dafb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b8c53f9b-65f5-4562-ba0a-f39c9c875044 tempest-GroupSnapshotsTest-1687054607 None] Created volume successfully.
Sep 03 08:08:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c45e4cbd-124e-4bdc-850b-82020370349d tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c45e4cbd-124e-4bdc-850b-82020370349d tempest-GroupSnapshotsTest-1687054607 None] Update group completed successfully.
Sep 03 08:08:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-0872f28c-d710-4491-8342-ae77101f1ed8 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-0872f28c-d710-4491-8342-ae77101f1ed8 tempest-GroupSnapshotsTest-1687054607 None] Update group completed successfully.
Sep 03 08:08:35 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8cb5da77-12c7-40a6-b7fa-5cb9993a7d98 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:35 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8cb5da77-12c7-40a6-b7fa-5cb9993a7d98 tempest-GroupSnapshotsTest-1687054607 None] Update group completed successfully.
Sep 03 08:08:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5132eebc-98ad-4b4f-9cc1-2bc768c85eb6 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5132eebc-98ad-4b4f-9cc1-2bc768c85eb6 tempest-GroupSnapshotsTest-1687054607 None] Update group completed successfully.
Sep 03 08:08:38 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] GroupSnapshot 369cbd2a-1a42-4747-91cb-47f17edbe5e5: creating.
Sep 03 08:08:38 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Group snapshot 369cbd2a-1a42-4747-91cb-47f17edbe5e5: creating. {{(pid=82397) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Creating offline snapshot 3164a87f-5f41-4fe8-9bb7-85d56df28b79 of volume 0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dab661-7e6c-4494-a8d8-58c9974e89e8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7" returned: 0 in 0.539s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:39 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=35, name=volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 1G" returned: 0 in 0.311s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0269d915-e562-41c0-8db0-316f4c8119a7 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:39 devstack quobyte-client[82407]: System call of process 88252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img rebase -u -b volume-0269d915-e562-41c0-8db0-316f4c8119a7 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79" returned: 0 in 0.310s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79" returned: 0 in 0.209s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:08:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79" returned: 0 in 0.163s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.info" returned: 0 in 0.164s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.info" returned: 0 in 0.270s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Creating offline snapshot aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 of volume 61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:08:41 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff381ac-6459-48a9-9355-22d3a9f82a1b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" returned: 0 in 0.946s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:42 devstack quobyte-client[82407]: System call of process 88285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:42 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=37, name=volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 1G" returned: 0 in 0.384s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img rebase -u -b volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:42 devstack quobyte-client[82407]: System call of process 88291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img rebase -u -b volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" returned: 0 in 0.253s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" returned: 0 in 0.106s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" returned: 0 in 0.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.info" returned: 0 in 0.162s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.info" returned: 0 in 0.141s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.123s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:44 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Flow 'volume_create_manager' (c3e59a66-6b89-499b-b45b-ff069a66aaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9766b4b2-af85-4aee-824e-12cdac8ed97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9766b4b2-af85-4aee-824e-12cdac8ed97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1758989473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f44be26-7c03-4154-a611-b2b204b58cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a0590eb46843ca9705c2e1e6f2e3e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:44Z,use_quota=True,user_id='9abc61180e104419b7ce27334726942e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c53fd3-ad75-4022-9691-9344ae602975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c53fd3-ad75-4022-9691-9344ae602975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41d3cf7-fbad-46d4-a365-60434eefa6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41d3cf7-fbad-46d4-a365-60434eefa6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f44be26-7c03-4154-a611-b2b204b58cf1', 'volume_name': 'volume-7f44be26-7c03-4154-a611-b2b204b58cf1', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac46f5bc-5853-4f18-bd71-0c749879cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac46f5bc-5853-4f18-bd71-0c749879cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43a8c49-4b30-4893-ab04-f33161010737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:44 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Volume 7f44be26-7c03-4154-a611-b2b204b58cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f44be26-7c03-4154-a611-b2b204b58cf1', 'volume_size': 1}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1758989473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f44be26-7c03-4154-a611-b2b204b58cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a0590eb46843ca9705c2e1e6f2e3e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:08:44Z,use_quota=True,user_id='9abc61180e104419b7ce27334726942e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Creating volume 7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:08:44 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:08:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:44 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=39, name=volume-7f44be26-7c03-4154-a611-b2b204b58cf1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-70f1d458-e3dc-4f9d-a0d9-d61a59b38c21 tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 369cbd2a-1a42-4747-91cb-47f17edbe5e5: created successfully
Sep 03 08:08:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 369cbd2a-1a42-4747-91cb-47f17edbe5e5: deleting
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 1073741824" returned: 0 in 0.626s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 369cbd2a-1a42-4747-91cb-47f17edbe5e5: deleting {{(pid=82397) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1" returned: 0 in 0.510s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] <== create_volume: return (1155ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-0269d915-e562-41c0-8db0-316f4c8119a7" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43a8c49-4b30-4893-ab04-f33161010737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f44be26-7c03-4154-a611-b2b204b58cf1', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fea9107-25b9-4e67-a3b0-f31c1a04690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-0269d915-e562-41c0-8db0-316f4c8119a7" acquired by "delete_snapshot" :: waited 0.097s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-3164a87f-5f41-4fe8-9bb7-85d56df28b79" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:45 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Volume volume-7f44be26-7c03-4154-a611-b2b204b58cf1 (7f44be26-7c03-4154-a611-b2b204b58cf1): created successfully
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fea9107-25b9-4e67-a3b0-f31c1a04690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Flow 'volume_create_manager' (c3e59a66-6b89-499b-b45b-ff069a66aaee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-3164a87f-5f41-4fe8-9bb7-85d56df28b79" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Deleting offline snapshot 3164a87f-5f41-4fe8-9bb7-85d56df28b79 of volume 0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:08:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] snapshot_file for this snap is: volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:08:46 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1512f8c-27f0-4f14-8756-179c63e68097]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-85a8c90b-2282-4f94-ad0d-83e4e3ce0b85 tempest-SnapshotMetadataTestJSON-2086875049 None] Created volume successfully.
Sep 03 08:08:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79" returned: 0 in 0.515s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0269d915-e562-41c0-8db0-316f4c8119a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:08:46 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc33a30-a564-4ee1-96f5-96e64b09c6be]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Creating offline snapshot 8cd83899-55bb-4a42-85ca-b53be3dd4022 of volume 7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[085e0df3-8866-400e-a0cd-6d86d9cdd02e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7" returned: 0 in 0.887s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79" returned: 0 in 0.279s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1" returned: 0 in 0.630s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:48 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=40, name=volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7.3164a87f-5f41-4fe8-9bb7-85d56df28b79" returned: 0 in 0.400s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.286s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 1G" returned: 0 in 0.441s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7f44be26-7c03-4154-a611-b2b204b58cf1 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-3164a87f-5f41-4fe8-9bb7-85d56df28b79" released by "_delete_snapshot" :: held 2.606s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:48 devstack quobyte-client[82407]: System call of process 88333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-0269d915-e562-41c0-8db0-316f4c8119a7" released by "delete_snapshot" :: held 2.737s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "qemu-img rebase -u -b volume-7f44be26-7c03-4154-a611-b2b204b58cf1 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022" returned: 0 in 0.332s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:08:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022" returned: 0 in 0.302s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" acquired by "delete_snapshot" :: waited 0.200s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022" returned: 0 in 0.186s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" acquired by "_delete_snapshot" :: waited 0.210s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Deleting offline snapshot aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 of volume 61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] snapshot_file for this snap is: volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.info" returned: 0 in 0.244s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7b2e5f-ae24-4cc6-8ebf-9984427eec4d]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.info" returned: 0 in 0.192s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b3118dfb-9298-4261-902c-0334f86d0907 tempest-SnapshotMetadataTestJSON-2086875049 None] Create snapshot completed successfully
Sep 03 08:08:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" returned: 0 in 0.640s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:08:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e9a15-56ce-4d08-8180-bdf4d7c0caac]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" returned: 0 in 0.466s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" returned: 0 in 0.264s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c.aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" returned: 0 in 0.364s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-aed52477-fb3e-4eec-ba3f-ebbc1da14fe1" released by "_delete_snapshot" :: held 2.273s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" released by "delete_snapshot" :: held 2.522s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:52 devstack cinder-volume[82397]: WARNING cinder.quota [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1079053053 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1079053053, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:52 devstack cinder-volume[82397]: WARNING cinder.quota [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1079053053 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1079053053, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['a5c6ba36-6ecb-4b53-8325-3303c17c06be', '8e27b4a6-217f-4fe1-ab75-c9ebdadc92c2', '81cb6a51-6ba0-47be-84e3-18dc2816d50a', '3d260fd6-eadf-4a08-a88a-287ef3790d60'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['38c3a5fa-04ce-4c57-bc48-79a3d3456433', '77f2ef0f-b80b-4cbc-8e80-bd10a61efcb5', '55f0fb8f-0dd8-4f97-a724-697dae76cd63', '058da541-c483-44df-96d2-6cddc07f3ee4'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "cinder-8cd83899-55bb-4a42-85ca-b53be3dd4022-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b49c0391-511d-4d8b-84aa-5f876285618a tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 369cbd2a-1a42-4747-91cb-47f17edbe5e5: deleted successfully
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-8cd83899-55bb-4a42-85ca-b53be3dd4022-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "cinder-quobyte-7f44be26-7c03-4154-a611-b2b204b58cf1" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-quobyte-7f44be26-7c03-4154-a611-b2b204b58cf1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "cinder-quobyte-8cd83899-55bb-4a42-85ca-b53be3dd4022" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-quobyte-8cd83899-55bb-4a42-85ca-b53be3dd4022" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Deleting offline snapshot 8cd83899-55bb-4a42-85ca-b53be3dd4022 of volume 7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] snapshot_file for this snap is: volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd36d6cc-52a9-4787-b902-bbeb713a4e58]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022" returned: 0 in 0.639s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f44be26-7c03-4154-a611-b2b204b58cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:08:53 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[daedc6aa-4af3-4b0d-99e3-a101db0fcb89]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-0269d915-e562-41c0-8db0-316f4c8119a7" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-0269d915-e562-41c0-8db0-316f4c8119a7" acquired by "delete_volume" :: waited 0.083s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0419c63-99a6-417b-b15a-3d66a3a31204]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1" returned: 0 in 0.798s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022" returned: 0 in 0.264s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:54 devstack quobyte-client[82407]: System call of process 88359 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7" returned: 0 in 0.598s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1.8cd83899-55bb-4a42-85ca-b53be3dd4022" returned: 0 in 0.144s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-quobyte-8cd83899-55bb-4a42-85ca-b53be3dd4022" released by "_delete_snapshot" :: held 2.447s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0269d915-e562-41c0-8db0-316f4c8119a7" returned: 0 in 0.191s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-quobyte-7f44be26-7c03-4154-a611-b2b204b58cf1" released by "delete_snapshot" :: held 2.513s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-0269d915-e562-41c0-8db0-316f4c8119a7" released by "delete_volume" :: held 1.096s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" acquired by "delete_volume" :: waited 0.041s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9415c886-16c8-4787-9288-de53de02bed5]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:55 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Created reservations ['ae91937b-3d54-457d-98d4-7f1c8de043b0', 'c1da3f3a-5559-418b-82ea-1829f2a58360', 'b07e01d9-2774-4235-9143-d9cfce125337', '4d2297e5-5d6b-497d-babf-39f8c8db9b9e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:56 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Delete snapshot completed successfully.
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7352699e-8ddf-49b6-a2c9-b9427e4fcf79 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-8cd83899-55bb-4a42-85ca-b53be3dd4022-delete_snapshot" released by "delete_snapshot" :: held 3.518s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" returned: 0 in 0.760s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-61cf89b7-7371-4c38-bff2-259ad8a1ac3c" released by "delete_volume" :: held 0.984s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['f1155f0b-c989-4686-950c-37c381ba4ff8'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:56 devstack cinder-volume[82397]: WARNING cinder.quota [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1079053053 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1079053053, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['01946485-14bb-4b9c-be70-af4170b19215', '9ccc3a9d-46c9-418d-a4f3-23b4e6f7866b', '92ea33c7-9e8b-4800-b92c-c2c7195ab3f3', '7b670a06-a2eb-4c59-a9f8-3a4a4a26932b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:56 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['41ae5c1c-e637-4ff1-93d4-4e3bae4a6596', '35f931fc-2925-496a-af12-faa010210e84', '590ee9e2-6409-44a6-b97c-7a36916c184a', '4ac48eba-8944-4507-97d5-b0388057904e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "cinder-7f44be26-7c03-4154-a611-b2b204b58cf1-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-7f44be26-7c03-4154-a611-b2b204b58cf1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:57 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "cinder-quobyte-7f44be26-7c03-4154-a611-b2b204b58cf1" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.351s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:08:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-11267a0a-561d-4cff-85e2-0c0cb3c3d4da tempest-GroupSnapshotsTest-1687054607 None] Delete group completed successfully.
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-quobyte-7f44be26-7c03-4154-a611-b2b204b58cf1" acquired by "delete_volume" :: waited 0.106s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f38de-15bf-45c5-baee-bce76cc7cadd]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:08:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:58 devstack quobyte-client[82407]: System call of process 88378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:08:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1" returned: 0 in 0.451s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7f44be26-7c03-4154-a611-b2b204b58cf1" returned: 0 in 0.156s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-quobyte-7f44be26-7c03-4154-a611-b2b204b58cf1" released by "delete_volume" :: held 0.906s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:58 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Created reservations ['1b3a9047-1652-4632-bba9-0e73670474e4', 'eef7025c-b708-4aeb-9bdc-248a68c3d217', '78a9ab08-0175-4311-b8fe-58ac911a1eb4', '4084ae20-0824-45af-a838-d21a28109fc6'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:08:59 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-16574149-67cc-49a6-b956-33485c93e1b7 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:08:59 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-16574149-67cc-49a6-b956-33485c93e1b7 tempest-GroupSnapshotsTest-1687054607 None] Group tempest-GroupSnapshotsTest-Group-1044210894: creating
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.361s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:08:59 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Deleted volume successfully.
Sep 03 08:08:59 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-16574149-67cc-49a6-b956-33485c93e1b7 tempest-GroupSnapshotsTest-1687054607 None] Group tempest-GroupSnapshotsTest-Group-1044210894: created successfully
Sep 03 08:08:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-184d6030-98b9-4a94-ad76-c5a851e18a94 tempest-SnapshotMetadataTestJSON-2086875049 None] Lock "cinder-7f44be26-7c03-4154-a611-b2b204b58cf1-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:08:59 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-16574149-67cc-49a6-b956-33485c93e1b7 tempest-GroupSnapshotsTest-1687054607 None] Create group completed successfully.
Sep 03 08:09:01 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (3b909b96-fc62-4669-af01-e32b6e0591f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccb7391-3477-49c4-ae0a-be4599516ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccb7391-3477-49c4-ae0a-be4599516ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-313765433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85e2ed8d-97d3-4597-8440-6f4bd919b129,host='devstack@QuobyteHD#QuobyteHD',id=e8188327-dc90-4ea4-a0b4-c81695f28d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:01Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f333d8c-4126-48b5-96e2-eb63b4c4a989),volume_type_id=2f333d8c-4126-48b5-96e2-eb63b4c4a989)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce4283a-b7f6-4ccd-a3d3-f2399da97188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce4283a-b7f6-4ccd-a3d3-f2399da97188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdd346c-9d4b-4166-af2c-1bbf9d741b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:01 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdd346c-9d4b-4166-af2c-1bbf9d741b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8188327-dc90-4ea4-a0b4-c81695f28d59', 'volume_name': 'volume-e8188327-dc90-4ea4-a0b4-c81695f28d59', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6a0e64-51df-4922-b7bd-8e20a006d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6a0e64-51df-4922-b7bd-8e20a006d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2bf5af-1651-4c6c-b701-15a323faa83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:02 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Volume e8188327-dc90-4ea4-a0b4-c81695f28d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8188327-dc90-4ea4-a0b4-c81695f28d59', 'volume_size': 1}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=85e2ed8d-97d3-4597-8440-6f4bd919b129,created_at=2025-09-03T06:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-313765433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85e2ed8d-97d3-4597-8440-6f4bd919b129,host='devstack@QuobyteHD#QuobyteHD',id=e8188327-dc90-4ea4-a0b4-c81695f28d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e877d3b7d14e94aa2e6a36aa715667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:01Z,use_quota=True,user_id='a54be820c068447290126a7bb18a96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f333d8c-4126-48b5-96e2-eb63b4c4a989),volume_type_id=2f333d8c-4126-48b5-96e2-eb63b4c4a989)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Creating volume e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.094s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:09:02 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:02 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=42, name=volume-e8188327-dc90-4ea4-a0b4-c81695f28d59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 1073741824" returned: 0 in 0.674s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59" returned: 0 in 0.291s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] <== create_volume: return (1184ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:09:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2bf5af-1651-4c6c-b701-15a323faa83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8188327-dc90-4ea4-a0b4-c81695f28d59', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0c6312-fa93-4fc8-925e-93c451193dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:04 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Volume volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 (e8188327-dc90-4ea4-a0b4-c81695f28d59): created successfully
Sep 03 08:09:04 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0c6312-fa93-4fc8-925e-93c451193dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:04 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Flow 'volume_create_manager' (3b909b96-fc62-4669-af01-e32b6e0591f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:04 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a480a6b0-b23b-49ad-a24d-dda189ed6dce tempest-GroupSnapshotsTest-1687054607 None] Created volume successfully.
Sep 03 08:09:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] GroupSnapshot 15b14e80-b8da-4714-96e5-75568244adb6: creating.
Sep 03 08:09:06 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Group snapshot 15b14e80-b8da-4714-96e5-75568244adb6: creating. {{(pid=82397) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 03 08:09:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Creating offline snapshot 9a1f2b91-33f7-43fe-ae78-043a38684117 of volume e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:09:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d1a24-b452-45f3-8211-66ed5ad6e156]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=99,cinder:UPDATE=109,cinder:INSERT=24,cinder:DELETE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=106,cinder:UPDATE=105,cinder:DELETE=4,cinder:INSERT=19 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:09:07 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:09:07 devstack quobyte-client[82407]: System call of process 88458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:09:07 devstack quobyte-client[82407]: System call of process 88458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Flow 'volume_create_manager' (609d0c9b-1638-4474-96ea-44fb7907e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8e442c-2c7b-4701-90ec-da08007b7b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8e442c-2c7b-4701-90ec-da08007b7b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1541204716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbfbedb2-0071-4a90-b726-3d7a784bf4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c3e23c3543420eaaa42f8776f26293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:06Z,use_quota=True,user_id='0e6cbb9ef6514dde9d4464d053e221f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de4d899-db63-4e1a-b07b-8d37d0aee42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de4d899-db63-4e1a-b07b-8d37d0aee42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaca4d2-98c7-4302-877c-d450ad202d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaca4d2-98c7-4302-877c-d450ad202d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbfbedb2-0071-4a90-b726-3d7a784bf4d7', 'volume_name': 'volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae09bf8f-f5e7-466e-b96e-e3f8d31aae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae09bf8f-f5e7-466e-b96e-e3f8d31aae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a94ae-bfd9-4187-931b-5ddfa4b62c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:07 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Volume dbfbedb2-0071-4a90-b726-3d7a784bf4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7', 'volume_size': 1}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59" returned: 0 in 1.552s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:08 devstack quobyte-client[82407]: System call of process 88471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:09:08 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=43, name=volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:09:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 1G" returned: 0 in 0.598s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img rebase -u -b volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117" returned: 0 in 0.447s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117" returned: 0 in 0.187s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.info" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.info" returned: 0 in 0.091s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.510s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.998s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1541204716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbfbedb2-0071-4a90-b726-3d7a784bf4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c3e23c3543420eaaa42f8776f26293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:06Z,use_quota=True,user_id='0e6cbb9ef6514dde9d4464d053e221f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Creating volume dbfbedb2-0071-4a90-b726-3d7a784bf4d7 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:09:09 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:09:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:10 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=45, name=volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:09:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7 1073741824" returned: 0 in 0.729s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:10 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 15b14e80-b8da-4714-96e5-75568244adb6: deleting
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7" returned: 0 in 0.503s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] <== create_volume: return (1289ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 15b14e80-b8da-4714-96e5-75568244adb6: deleting {{(pid=82397) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 03 08:09:11 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-47b13a74-5db9-4eed-8435-c14ab2790c66 tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 15b14e80-b8da-4714-96e5-75568244adb6: created successfully
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0a94ae-bfd9-4187-931b-5ddfa4b62c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fad21a8-951a-45c8-8145-ca2864570916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:11 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Volume volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7 (dbfbedb2-0071-4a90-b726-3d7a784bf4d7): created successfully
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fad21a8-951a-45c8-8145-ca2864570916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Flow 'volume_create_manager' (609d0c9b-1638-4474-96ea-44fb7907e596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-e8188327-dc90-4ea4-a0b4-c81695f28d59" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:11 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-017940e1-2284-41c7-8088-c65c21e24cc1 tempest-VolumesMetadataTest-1571220833 None] Created volume successfully.
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-e8188327-dc90-4ea4-a0b4-c81695f28d59" acquired by "delete_snapshot" :: waited 0.063s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-9a1f2b91-33f7-43fe-ae78-043a38684117" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-9a1f2b91-33f7-43fe-ae78-043a38684117" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Deleting offline snapshot 9a1f2b91-33f7-43fe-ae78-043a38684117 of volume e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] snapshot_file for this snap is: volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee60f95-ccc1-4faa-9e18-4f31937c9007]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117" returned: 0 in 0.426s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8188327-dc90-4ea4-a0b4-c81695f28d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:09:12 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ffaf98-c8a1-4fc3-a11f-53a8e554c192]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59" returned: 0 in 0.510s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:12 devstack quobyte-client[82407]: System call of process 88493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:09:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117" returned: 0 in 0.215s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59.9a1f2b91-33f7-43fe-ae78-043a38684117" returned: 0 in 0.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-9a1f2b91-33f7-43fe-ae78-043a38684117" released by "_delete_snapshot" :: held 1.674s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-e8188327-dc90-4ea4-a0b4-c81695f28d59" released by "delete_snapshot" :: held 1.703s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Acquiring lock "cinder-dbfbedb2-0071-4a90-b726-3d7a784bf4d7-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:13 devstack cinder-volume[82397]: WARNING cinder.quota [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1833807642 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1833807642, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:09:13 devstack cinder-volume[82397]: WARNING cinder.quota [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1833807642 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1833807642, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Lock "cinder-dbfbedb2-0071-4a90-b726-3d7a784bf4d7-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Acquiring lock "cinder-quobyte-dbfbedb2-0071-4a90-b726-3d7a784bf4d7" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['f5c61ba7-e522-4617-8f5b-f1a7e3128ce0', '22cf434f-8977-4d37-995c-18084ffa3e77', '9421b45c-6053-4051-97fa-1c27e0c624a9', 'e3805130-5bf5-41fe-a1d0-71c3b7f99be5'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Lock "cinder-quobyte-dbfbedb2-0071-4a90-b726-3d7a784bf4d7" acquired by "delete_volume" :: waited 0.032s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[99571b92-65ca-433d-91f6-cf09ce089ffd]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-6314c205-50cf-48cf-945a-f6d04daab533 tempest-GroupSnapshotsTest-1687054607 None] group_snapshot 15b14e80-b8da-4714-96e5-75568244adb6: deleted successfully
Sep 03 08:09:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7" returned: 0 in 0.510s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dbfbedb2-0071-4a90-b726-3d7a784bf4d7" returned: 0 in 0.125s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Lock "cinder-quobyte-dbfbedb2-0071-4a90-b726-3d7a784bf4d7" released by "delete_volume" :: held 0.838s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "cinder-quobyte-e8188327-dc90-4ea4-a0b4-c81695f28d59" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Created reservations ['3b4ee901-6be9-409e-8e42-b48e657b9720', '5b9f376d-7416-4733-990c-1a600578133f', '4eaaf730-9439-4776-aa6e-4daaadf875c4', 'f2a58fb3-d997-4b7e-a935-2c54e37cd5f6'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-e8188327-dc90-4ea4-a0b4-c81695f28d59" acquired by "delete_volume" :: waited 0.067s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db14f6-c59c-43ff-a535-686acccfc4a6]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.184s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:09:15 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Deleted volume successfully.
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59" returned: 0 in 0.714s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12894329-24b2-4431-b260-cf83da94223d tempest-VolumesMetadataTest-1571220833 None] Lock "cinder-dbfbedb2-0071-4a90-b726-3d7a784bf4d7-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e8188327-dc90-4ea4-a0b4-c81695f28d59" returned: 0 in 0.290s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Lock "cinder-quobyte-e8188327-dc90-4ea4-a0b4-c81695f28d59" released by "delete_volume" :: held 1.111s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['de38e71a-988b-4add-88cb-034eca579f8e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:09:16 devstack cinder-volume[82397]: WARNING cinder.quota [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1833807642 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1833807642, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Created reservations ['79b71435-016e-4582-9c14-57d6c90d008b', '1a608288-5265-4f3f-a95e-3d90a268eee4', '0aad8643-d1e4-4ef5-aa64-de35be61c26a', '6f8071c0-8800-46c9-a76c-55e3c53e64fe'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.113s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:17 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:09:17 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2ebf3a3b-eafa-4f45-99cb-b211fb9b7b24 tempest-GroupSnapshotsTest-1687054607 None] Delete group completed successfully.
Sep 03 08:09:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:09:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Flow 'volume_create_manager' (f0cfe1e3-5714-45bc-a0be-fd288d7686a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2847fea2-f09e-4972-a287-469bb9300855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2847fea2-f09e-4972-a287-469bb9300855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-851517294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4caf3ee-fe5e-4389-a63b-5601c7211c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a4941377414f8985152bd62505fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:22Z,use_quota=True,user_id='337309fd4b614ab497df0753ce96d277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c143935-9c90-4c38-bab5-6e691e51f507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c143935-9c90-4c38-bab5-6e691e51f507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8e6c29-955e-4111-b09c-99813e066474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8e6c29-955e-4111-b09c-99813e066474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4caf3ee-fe5e-4389-a63b-5601c7211c27', 'volume_name': 'volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1c9fd-60df-4f78-bf22-6e3c3608340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1c9fd-60df-4f78-bf22-6e3c3608340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc0257a-5af6-44c6-a0ad-1b73f662b3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Volume b4caf3ee-fe5e-4389-a63b-5601c7211c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27', 'volume_size': 1}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-851517294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4caf3ee-fe5e-4389-a63b-5601c7211c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a4941377414f8985152bd62505fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:22Z,use_quota=True,user_id='337309fd4b614ab497df0753ce96d277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Creating volume b4caf3ee-fe5e-4389-a63b-5601c7211c27 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:09:23 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:23 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=46, name=volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27 1073741824" returned: 0 in 0.488s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27" returned: 0 in 0.118s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] <== create_volume: return (692ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:09:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc0257a-5af6-44c6-a0ad-1b73f662b3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76e417f-11f8-4e0b-9ac0-52b78f4a84ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Volume volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27 (b4caf3ee-fe5e-4389-a63b-5601c7211c27): created successfully
Sep 03 08:09:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76e417f-11f8-4e0b-9ac0-52b78f4a84ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Flow 'volume_create_manager' (f0cfe1e3-5714-45bc-a0be-fd288d7686a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-9fa11a55-9676-44c4-8bc1-4f9c3edd60c4 tempest-VolumesTransfersV357Test-495466400 None] Created volume successfully.
Sep 03 08:09:26 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c0f93832-1929-47ca-87f6-b15916e08d52 tempest-VolumesTransfersV357Test-13399955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c0f93832-1929-47ca-87f6-b15916e08d52 tempest-VolumesTransfersV357Test-13399955 None] Transfer volume completed successfully.
Sep 03 08:09:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Acquiring lock "cinder-b4caf3ee-fe5e-4389-a63b-5601c7211c27-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-b4caf3ee-fe5e-4389-a63b-5601c7211c27-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Acquiring lock "cinder-quobyte-b4caf3ee-fe5e-4389-a63b-5601c7211c27" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-quobyte-b4caf3ee-fe5e-4389-a63b-5601c7211c27" acquired by "delete_volume" :: waited 0.024s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1034a942-d143-44d9-98aa-a1c61be17a53]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27" returned: 0 in 0.501s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b4caf3ee-fe5e-4389-a63b-5601c7211c27" returned: 0 in 0.206s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-quobyte-b4caf3ee-fe5e-4389-a63b-5601c7211c27" released by "delete_volume" :: held 1.015s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:29 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Created reservations ['34256190-fb32-4ab6-a216-fb415cce2eaa', '97b57a6a-cd37-40ca-ab69-9274d55aa687', '1f1e20fc-a2ad-44a7-a47d-08d4037b599a', '5412fefa-82eb-4a4b-8a18-96d3ebecf276'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.120s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:09:30 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Deleted volume successfully.
Sep 03 08:09:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-62b8b03d-d9f6-4742-aed7-08865d9d5f1b tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-b4caf3ee-fe5e-4389-a63b-5601c7211c27-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:31 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Flow 'volume_create_manager' (40f61448-2380-484e-922e-b4ed592cbd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad72d61-3c35-4367-ade4-bb99ae1f3285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad72d61-3c35-4367-ade4-bb99ae1f3285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1515343196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f6a991-78b7-4851-8adb-9cbc192784b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a4941377414f8985152bd62505fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:32Z,use_quota=True,user_id='337309fd4b614ab497df0753ce96d277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61011ca9-9e7c-4467-a778-139f8a0fcf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61011ca9-9e7c-4467-a778-139f8a0fcf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12efd150-d7c0-4dbb-8d79-237657e46872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12efd150-d7c0-4dbb-8d79-237657e46872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f6a991-78b7-4851-8adb-9cbc192784b8', 'volume_name': 'volume-b0f6a991-78b7-4851-8adb-9cbc192784b8', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d67c94b-53f9-45c7-b0b3-9a1db4dfddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d67c94b-53f9-45c7-b0b3-9a1db4dfddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aaaf3a-39bb-42c0-bed5-2bace9266bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Volume b0f6a991-78b7-4851-8adb-9cbc192784b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f6a991-78b7-4851-8adb-9cbc192784b8', 'volume_size': 1}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1515343196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f6a991-78b7-4851-8adb-9cbc192784b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a4941377414f8985152bd62505fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:32Z,use_quota=True,user_id='337309fd4b614ab497df0753ce96d277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Creating volume b0f6a991-78b7-4851-8adb-9cbc192784b8 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:09:31 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:09:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:32 devstack quobyte-client[82407]: System call of process 88555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:09:32 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=47, name=volume-b0f6a991-78b7-4851-8adb-9cbc192784b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8 1073741824" returned: 0 in 0.458s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8" returned: 0 in 0.188s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] <== create_volume: return (755ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aaaf3a-39bb-42c0-bed5-2bace9266bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f6a991-78b7-4851-8adb-9cbc192784b8', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c17a17-0a96-496f-9eca-1c0665684d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:32 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Volume volume-b0f6a991-78b7-4851-8adb-9cbc192784b8 (b0f6a991-78b7-4851-8adb-9cbc192784b8): created successfully
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c17a17-0a96-496f-9eca-1c0665684d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Flow 'volume_create_manager' (40f61448-2380-484e-922e-b4ed592cbd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-dffc8d53-33f3-4556-9064-411da3212f54 tempest-VolumesTransfersV357Test-495466400 None] Created volume successfully.
Sep 03 08:09:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Acquiring lock "cinder-b0f6a991-78b7-4851-8adb-9cbc192784b8-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-b0f6a991-78b7-4851-8adb-9cbc192784b8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:34 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Acquiring lock "cinder-quobyte-b0f6a991-78b7-4851-8adb-9cbc192784b8" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-quobyte-b0f6a991-78b7-4851-8adb-9cbc192784b8" acquired by "delete_volume" :: waited 0.019s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7115121-bb15-470f-b166-381a476a8cd8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:34 devstack quobyte-client[82407]: System call of process 88560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8" returned: 0 in 0.548s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0f6a991-78b7-4851-8adb-9cbc192784b8" returned: 0 in 0.124s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-quobyte-b0f6a991-78b7-4851-8adb-9cbc192784b8" released by "delete_volume" :: held 0.837s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Created reservations ['3590a44a-36b5-4ad4-9afa-cc0a74a3103a', '89035101-1118-405f-bd4a-0c4ea84adf77', 'ec852b4a-7167-4dd9-a374-cc355414f1cd', '030d31f9-49f9-4d28-8cfa-3ce7eca1cf8b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:35 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:09:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Deleted volume successfully.
Sep 03 08:09:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-da17d108-03ca-450f-8535-ff858281e6fb tempest-VolumesTransfersV357Test-929234282 None] Lock "cinder-b0f6a991-78b7-4851-8adb-9cbc192784b8-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Flow 'volume_create_manager' (f8a65d2e-b3f2-4ad5-ad89-5b4486288a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad29a4f-dc07-44c6-894f-edc1661cadf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad29a4f-dc07-44c6-894f-edc1661cadf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-179768635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747c6c89-4fee-461f-961a-29601ce8b224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89ac17a89474eb39b8a40ed746ece45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:45Z,use_quota=True,user_id='a6584c6578f6404d9c6f0b92270d314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954f7443-854d-415b-9fe6-6ea220aa2836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954f7443-854d-415b-9fe6-6ea220aa2836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ae69a-046d-4b2c-9a96-acbc92823f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ae69a-046d-4b2c-9a96-acbc92823f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747c6c89-4fee-461f-961a-29601ce8b224', 'volume_name': 'volume-747c6c89-4fee-461f-961a-29601ce8b224', 'volume_size': 2}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0969410-ea9e-4975-ad42-252ae04735b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0969410-ea9e-4975-ad42-252ae04735b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4565aaf9-4a15-44c3-b860-b511aff57b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:45 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Volume 747c6c89-4fee-461f-961a-29601ce8b224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747c6c89-4fee-461f-961a-29601ce8b224', 'volume_size': 2}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-179768635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747c6c89-4fee-461f-961a-29601ce8b224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89ac17a89474eb39b8a40ed746ece45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:09:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:09:45Z,use_quota=True,user_id='a6584c6578f6404d9c6f0b92270d314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Creating volume 747c6c89-4fee-461f-961a-29601ce8b224 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:09:45 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:09:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224 2147483648 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:45 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=48, name=volume-747c6c89-4fee-461f-961a-29601ce8b224, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224 2147483648" returned: 0 in 0.518s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] <== create_volume: return (706ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4565aaf9-4a15-44c3-b860-b511aff57b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747c6c89-4fee-461f-961a-29601ce8b224', 'volume_size': 2}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5240a9d-1c12-4609-a48c-96cd0d668c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:09:46 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Volume volume-747c6c89-4fee-461f-961a-29601ce8b224 (747c6c89-4fee-461f-961a-29601ce8b224): created successfully
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5240a9d-1c12-4609-a48c-96cd0d668c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:09:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Flow 'volume_create_manager' (f8a65d2e-b3f2-4ad5-ad89-5b4486288a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:09:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cd1e3788-8afd-4deb-93ed-21360375df98 tempest-VolumesCloneNegativeTest-1582802780 None] Created volume successfully.
Sep 03 08:09:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Acquiring lock "cinder-747c6c89-4fee-461f-961a-29601ce8b224-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "cinder-747c6c89-4fee-461f-961a-29601ce8b224-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:09:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Acquiring lock "cinder-quobyte-747c6c89-4fee-461f-961a-29601ce8b224" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:09:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "cinder-quobyte-747c6c89-4fee-461f-961a-29601ce8b224" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:09:47 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c883fc02-a34e-49d0-9eaf-783723717713]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:09:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.167s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224" returned: 0 in 0.636s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-747c6c89-4fee-461f-961a-29601ce8b224" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "cinder-quobyte-747c6c89-4fee-461f-961a-29601ce8b224" released by "delete_volume" :: held 0.900s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Created reservations ['03ac1f40-80a9-4858-9d08-01a5a6e5c751', '012724b8-f08a-41e3-8ed8-fefc920b81eb', 'e92020b6-a23d-468b-8706-6813743f541c', 'c556c6ec-6e39-4e6b-8373-12399a75d89e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.126s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:09:49 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Deleted volume successfully.
Sep 03 08:09:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-39c0a796-a6ac-4e3a-9958-9675f9cd2980 tempest-VolumesCloneNegativeTest-1582802780 None] Lock "cinder-747c6c89-4fee-461f-961a-29601ce8b224-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:09:59 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=45,cinder:UPDATE=60,cinder:DELETE=5,cinder:INSERT=7 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:09:59 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=58,cinder:SELECT=41,cinder:INSERT=18,cinder:DELETE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:10:03 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Flow 'volume_create_manager' (9c37e269-6230-4643-9e2e-62fd3fa5bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad13697b-02be-4874-a844-709986be6f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad13697b-02be-4874-a844-709986be6f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-609453886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccf332f-3473-44fa-9085-d9168da9a828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42048c2e466948fa9c91d857e8452390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:10:03Z,use_quota=True,user_id='faad4a478439445cb90983b760192d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be359f-24a3-4719-8966-41ac12297923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be359f-24a3-4719-8966-41ac12297923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f196af-a04f-4d2b-aad8-cc9a8ad070e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f196af-a04f-4d2b-aad8-cc9a8ad070e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ccf332f-3473-44fa-9085-d9168da9a828', 'volume_name': 'volume-5ccf332f-3473-44fa-9085-d9168da9a828', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dec01bc-f20a-4a8c-9758-eeba7fbb1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dec01bc-f20a-4a8c-9758-eeba7fbb1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33998b42-099d-491b-82df-8fc65808c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:03 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Volume 5ccf332f-3473-44fa-9085-d9168da9a828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ccf332f-3473-44fa-9085-d9168da9a828', 'volume_size': 1}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-609453886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccf332f-3473-44fa-9085-d9168da9a828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42048c2e466948fa9c91d857e8452390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:10:03Z,use_quota=True,user_id='faad4a478439445cb90983b760192d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Creating volume 5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:10:03 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:10:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:03 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=49, name=volume-5ccf332f-3473-44fa-9085-d9168da9a828, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:10:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 1073741824" returned: 0 in 0.578s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828" returned: 0 in 0.327s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:04 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:10:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33998b42-099d-491b-82df-8fc65808c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ccf332f-3473-44fa-9085-d9168da9a828', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9f663a-5afe-4969-bbb9-9fc7636101ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:05 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Volume volume-5ccf332f-3473-44fa-9085-d9168da9a828 (5ccf332f-3473-44fa-9085-d9168da9a828): created successfully
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9f663a-5afe-4969-bbb9-9fc7636101ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Flow 'volume_create_manager' (9c37e269-6230-4643-9e2e-62fd3fa5bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:10:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-635a3a1d-1806-4c76-bf69-d00187309acd tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Created volume successfully.
Sep 03 08:10:05 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Creating offline snapshot bbfe6e71-63c3-435d-9c09-876cbc3ff78b of volume 5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f337b4e8-6628-411c-8878-69831e2848b9]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:10:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828" returned: 0 in 0.620s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:06 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=50, name=volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b 1G" returned: 0 in 0.405s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5ccf332f-3473-44fa-9085-d9168da9a828 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "qemu-img rebase -u -b volume-5ccf332f-3473-44fa-9085-d9168da9a828 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b" returned: 0 in 0.241s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b" returned: 0 in 0.141s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b" returned: 0 in 0.152s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.info" returned: 0 in 0.170s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:10:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.info" returned: 0 in 0.301s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:08 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-1cddc436-90ef-4d92-bd5b-d6d906931ee8 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Create snapshot completed successfully
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "cinder-bbfe6e71-63c3-435d-9c09-876cbc3ff78b-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-bbfe6e71-63c3-435d-9c09-876cbc3ff78b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:09 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "cinder-quobyte-5ccf332f-3473-44fa-9085-d9168da9a828" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-quobyte-5ccf332f-3473-44fa-9085-d9168da9a828" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "cinder-quobyte-bbfe6e71-63c3-435d-9c09-876cbc3ff78b" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-quobyte-bbfe6e71-63c3-435d-9c09-876cbc3ff78b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Deleting offline snapshot bbfe6e71-63c3-435d-9c09-876cbc3ff78b of volume 5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] snapshot_file for this snap is: volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5330bff8-c186-4f3f-af0c-ce7f66493845]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:10:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:10 devstack quobyte-client[82407]: System call of process 88626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:10:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b" returned: 0 in 0.497s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ccf332f-3473-44fa-9085-d9168da9a828(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:10:10 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d125c6-2bf3-472e-9670-472d6dcc81fe]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:10:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828" returned: 0 in 0.550s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b" returned: 0 in 0.279s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828.bbfe6e71-63c3-435d-9c09-876cbc3ff78b" returned: 0 in 0.107s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-quobyte-bbfe6e71-63c3-435d-9c09-876cbc3ff78b" released by "_delete_snapshot" :: held 1.809s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-quobyte-5ccf332f-3473-44fa-9085-d9168da9a828" released by "delete_snapshot" :: held 1.843s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:11 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Created reservations ['068a2d4d-22e3-4309-9b1f-dc1fcf95b000', 'a574aa1a-1e16-4e0c-bd9b-7edc66ef9201', '309f5e78-5376-4d64-a396-76d83fdd11b0', '12a2dbf4-5694-434e-9092-41b29f55071f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:10:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Delete snapshot completed successfully.
Sep 03 08:10:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d2a83bd0-06c9-4127-bc36-23043f5a6803 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-bbfe6e71-63c3-435d-9c09-876cbc3ff78b-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "cinder-5ccf332f-3473-44fa-9085-d9168da9a828-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-5ccf332f-3473-44fa-9085-d9168da9a828-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "cinder-quobyte-5ccf332f-3473-44fa-9085-d9168da9a828" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-quobyte-5ccf332f-3473-44fa-9085-d9168da9a828" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdbf76f-93b3-4a57-9c9f-2fd7049cce67]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828" returned: 0 in 0.564s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5ccf332f-3473-44fa-9085-d9168da9a828" returned: 0 in 0.181s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-quobyte-5ccf332f-3473-44fa-9085-d9168da9a828" released by "delete_volume" :: held 1.020s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Created reservations ['b1ca6aa6-5b06-4040-8c26-19b015ba29c7', 'd8b0e08f-e4c3-4563-bda7-0aff8917d866', 'bbb21983-0fbd-477c-bb42-b9e840636752', '818ade1e-237d-45c1-92d1-9a364db7b950'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.133s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:15 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:10:15 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Deleted volume successfully.
Sep 03 08:10:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ff24c3d2-7efa-49c4-85af-ff05d392c6f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-815201226 None] Lock "cinder-5ccf332f-3473-44fa-9085-d9168da9a828-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:24 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=18,cinder:DELETE=1,cinder:SELECT=10,cinder:INSERT=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:10:25 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:10:29 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Flow 'volume_create_manager' (b3a841ba-4173-473e-8d2d-7b3a409d93ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf74fbb-236d-4937-8fab-373cd4e07f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf74fbb-236d-4937-8fab-373cd4e07f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1197903539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bf83e1-8c27-4f3c-ba5d-7d1179a6248d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ad905ba1784bc597e216bfed9fcca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:10:29Z,use_quota=True,user_id='b0d0ac992c0547bda1b43c6b38d91d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a9fb906-9831-47d7-811d-7ff6afcd093d),volume_type_id=8a9fb906-9831-47d7-811d-7ff6afcd093d)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7f028f-e8e6-4bb6-bc1e-4182da4a902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7f028f-e8e6-4bb6-bc1e-4182da4a902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439e0870-6ac4-439f-a49d-853a9a79e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439e0870-6ac4-439f-a49d-853a9a79e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bf83e1-8c27-4f3c-ba5d-7d1179a6248d', 'volume_name': 'volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde7e198-11ae-41f7-af44-cb2615f66777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde7e198-11ae-41f7-af44-cb2615f66777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a654447e-5c55-4927-8475-48f6467fb166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:29 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Volume 80bf83e1-8c27-4f3c-ba5d-7d1179a6248d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d', 'volume_size': 1}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1197903539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bf83e1-8c27-4f3c-ba5d-7d1179a6248d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ad905ba1784bc597e216bfed9fcca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:10:29Z,use_quota=True,user_id='b0d0ac992c0547bda1b43c6b38d91d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a9fb906-9831-47d7-811d-7ff6afcd093d),volume_type_id=8a9fb906-9831-47d7-811d-7ff6afcd093d)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Creating volume 80bf83e1-8c27-4f3c-ba5d-7d1179a6248d {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:10:29 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:10:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:29 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=52, name=volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:10:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d 1073741824" returned: 0 in 0.446s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "cinder-18b80e06-dc35-4b8c-a158-396f3a869bc4-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d" returned: 0 in 0.632s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] <== create_volume: return (1125ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:10:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-18b80e06-dc35-4b8c-a158-396f3a869bc4-delete_volume" acquired by "delete_volume" :: waited 0.400s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a654447e-5c55-4927-8475-48f6467fb166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aae5975-d7b9-4394-9e90-8323b1c72ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:10:31 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "cinder-quobyte-18b80e06-dc35-4b8c-a158-396f3a869bc4" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Volume volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d (80bf83e1-8c27-4f3c-ba5d-7d1179a6248d): created successfully
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aae5975-d7b9-4394-9e90-8323b1c72ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Flow 'volume_create_manager' (b3a841ba-4173-473e-8d2d-7b3a409d93ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-quobyte-18b80e06-dc35-4b8c-a158-396f3a869bc4" acquired by "delete_volume" :: waited 0.048s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-85ddf69d-228d-496b-a754-45698bad5f2c tempest-VolumeTypesAccessTest-319171532 None] Created volume successfully.
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a81b178-6f8d-4241-a11f-1579494b99f8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:10:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4" returned: 0 in 0.769s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-18b80e06-dc35-4b8c-a158-396f3a869bc4" returned: 0 in 0.275s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-quobyte-18b80e06-dc35-4b8c-a158-396f3a869bc4" released by "delete_volume" :: held 1.316s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Acquiring lock "cinder-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Lock "cinder-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Created reservations ['e68c650c-acd8-47ea-ad7e-7a9c6efeeb63', '4c334c32-81c3-4e03-95ea-ed97f2caf475', '905ad89c-0b82-4cf3-b695-4381859fbbc1', '6550a1a2-16d5-426f-b443-2c51bb2feddc'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:10:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Acquiring lock "cinder-quobyte-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Lock "cinder-quobyte-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d" acquired by "delete_volume" :: waited 0.039s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc3d39c-e5b6-41fd-8f3c-7628c285bdc6]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.209s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:33 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:10:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Deleted volume successfully.
Sep 03 08:10:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6da8dea-8ed4-40c9-9895-0b684b553d63 tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-18b80e06-dc35-4b8c-a158-396f3a869bc4-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d" returned: 0 in 1.026s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d" returned: 0 in 0.273s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "cinder-e3c14a31-d99c-4801-ac6b-bdd09b5f934c-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Lock "cinder-quobyte-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d" released by "delete_volume" :: held 1.617s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-e3c14a31-d99c-4801-ac6b-bdd09b5f934c-delete_volume" acquired by "delete_volume" :: waited 0.291s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:35 devstack cinder-volume[82397]: WARNING cinder.quota [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-196914957 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-196914957, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:10:35 devstack cinder-volume[82397]: WARNING cinder.quota [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-196914957 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-196914957, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:10:35 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:10:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "cinder-quobyte-e3c14a31-d99c-4801-ac6b-bdd09b5f934c" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:10:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-quobyte-e3c14a31-d99c-4801-ac6b-bdd09b5f934c" acquired by "delete_volume" :: waited 0.027s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:10:35 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb3e47-fbfe-4b25-aef9-b4a863cd5065]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:10:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:35 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Created reservations ['c228af8d-cb26-4048-a9e7-adfb4984370e', '3a2a7838-e7ae-4d8b-b224-657e0866f7e6', 'a6772403-1d4e-409f-af18-ece7e4b7b655', '0f22b62c-b7f6-4319-9f8d-b5696a216c88'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:36 devstack quobyte-client[82407]: System call of process 88743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c" returned: 0 in 1.283s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.621s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:37 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:10:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Deleted volume successfully.
Sep 03 08:10:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-e3c14a31-d99c-4801-ac6b-bdd09b5f934c" returned: 0 in 0.723s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-quobyte-e3c14a31-d99c-4801-ac6b-bdd09b5f934c" released by "delete_volume" :: held 2.241s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b616e94c-1ae1-431f-a5c3-0aaf630e4286 tempest-VolumeTypesAccessTest-319171532 None] Lock "cinder-80bf83e1-8c27-4f3c-ba5d-7d1179a6248d-delete_volume" released by "delete_volume" :: held 4.737s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Created reservations ['42e7019c-c903-4fbb-8b0d-6b784cf29d9a', '3e26fcc4-b79c-4c77-846c-0c9bf8f9b56f', '16803220-2ea0-4cbb-8e35-3f4de94f70ba', '5f62bdcc-ce6f-4363-91e7-0a67ab200e11'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.332s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:38 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:10:39 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Deleted volume successfully.
Sep 03 08:10:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-33d63a6c-e1e5-4051-94f4-c5cc669981de tempest-AttachVolumeShelveTestJSON-1388624222 None] Lock "cinder-e3c14a31-d99c-4801-ac6b-bdd09b5f934c-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.248s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:10:48 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:DELETE=3,cinder:INSERT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:10:49 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=43,cinder:SELECT=18,cinder:INSERT=11,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:11:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:11:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:11:08 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:11:08 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:11:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Flow 'volume_create_manager' (7b727aa7-6fef-4e95-8395-2b7b14d56b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:11:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4f1dda-e423-48b5-81b6-9efd58adbf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4f1dda-e423-48b5-81b6-9efd58adbf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-893397665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd010ea3-ffba-4e62-86e0-68310b403fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe024ae5183e4fabbc568c59024eeab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:11:08Z,use_quota=True,user_id='01195c47e5254429a3c6a52ba754b964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6467bd6b-a16d-498d-9b5a-7607ca38c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6467bd6b-a16d-498d-9b5a-7607ca38c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fc7ece-8fb9-44ea-8fd5-7996d940744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fc7ece-8fb9-44ea-8fd5-7996d940744a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd010ea3-ffba-4e62-86e0-68310b403fe2', 'volume_name': 'volume-cd010ea3-ffba-4e62-86e0-68310b403fe2', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b691bd210>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae1e743-0321-404a-9a4c-8ffdb746c056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae1e743-0321-404a-9a4c-8ffdb746c056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1398c4-9db5-4e60-b2d4-1cbc967bcc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:09 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Volume cd010ea3-ffba-4e62-86e0-68310b403fe2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd010ea3-ffba-4e62-86e0-68310b403fe2', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b691bd210>}
Sep 03 08:11:09 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Cloning cd010ea3-ffba-4e62-86e0-68310b403fe2 from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22  at location (None, None). {{(pid=82397) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}}
Sep 03 08:11:10 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD, size 20.69 MB, duration 1.42 sec {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 03 08:11:10 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Image download 20.69 MB at 14.62 MB/s
Sep 03 08:11:11 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e36491-6e52-4e11-ac2e-77062ee357a1]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:11 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD
Sep 03 08:11:11 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:11:14 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Sep 03 08:11:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD" returned: 0 in 3.842s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:14 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 is fetched for user 01195c47e5254429a3c6a52ba754b964. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 03 08:11:15 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0efdc-fd34-4a4e-9de3-d53cad30bc96]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:16 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD
Sep 03 08:11:16 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:11:18 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD" returned: 0 in 3.165s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-893397665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd010ea3-ffba-4e62-86e0-68310b403fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe024ae5183e4fabbc568c59024eeab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:11:08Z,use_quota=True,user_id='01195c47e5254429a3c6a52ba754b964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Creating volume cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:11:18 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:11:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:18 devstack quobyte-client[82407]: System call of process 88877 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:11:18 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=53, name=volume-cd010ea3-ffba-4e62-86e0-68310b403fe2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 1073741824" returned: 0 in 0.519s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2" returned: 0 in 0.130s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Attempting download of 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume cd010ea3-ffba-4e62-86e0-68310b403fe2. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11804bb-4be0-4dc8-8b69-4f81a1a4f58b]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z56td6it {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z56td6it" returned: 0 in 0.374s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z56td6it {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z56td6it" returned: 1 in 0.404s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z56td6it' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:11:20 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3ade6-2d38-498e-aefe-db4642477ebe]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:21 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] 870a0d94-8d05-4c7b-aab1-1837efb2cb22 was qcow2, converting to raw {{(pid=82397) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 03 08:11:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:21 devstack quobyte-client[82407]: System call of process 88889 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:11:21 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=53, name=volume-cd010ea3-ffba-4e62-86e0-68310b403fe2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:11:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2" returned: 0 in 1.223s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:22 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_eqjlnxjbdevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:11:22 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Converted 112.00 MB image at 89.76 MB/s
Sep 03 08:11:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 1G" returned: 0 in 0.161s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:22 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b69698-b460-400e-84de-025593defb61]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2" returned: 0 in 0.480s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2" returned: 1 in 0.469s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Downloaded image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume cd010ea3-ffba-4e62-86e0-68310b403fe2 successfully. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 for user 01195c47e5254429a3c6a52ba754b964 is deleted. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Marking volume cd010ea3-ffba-4e62-86e0-68310b403fe2 as bootable. {{(pid=82397) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Copying metadata from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 to cd010ea3-ffba-4e62-86e0-68310b403fe2. {{(pid=82397) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Creating volume glance metadata for volume cd010ea3-ffba-4e62-86e0-68310b403fe2 backed by image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82397) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1398c4-9db5-4e60-b2d4-1cbc967bcc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd010ea3-ffba-4e62-86e0-68310b403fe2', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b691bd210>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808dbdc4-f4b3-459d-bd83-1d4ad8c10b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Volume volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 (cd010ea3-ffba-4e62-86e0-68310b403fe2): created successfully
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808dbdc4-f4b3-459d-bd83-1d4ad8c10b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Flow 'volume_create_manager' (7b727aa7-6fef-4e95-8395-2b7b14d56b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:11:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-371282ae-99dc-4ca8-9787-ba420f2835b7 tempest-VolumesImageMetadata-1596118873 None] Created volume successfully.
Sep 03 08:11:26 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Acquiring lock "cinder-cd010ea3-ffba-4e62-86e0-68310b403fe2-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:11:26 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Lock "cinder-cd010ea3-ffba-4e62-86e0-68310b403fe2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:11:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:11:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Acquiring lock "cinder-quobyte-cd010ea3-ffba-4e62-86e0-68310b403fe2" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:11:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Lock "cinder-quobyte-cd010ea3-ffba-4e62-86e0-68310b403fe2" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:11:27 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[324182b7-d594-4bcc-a61f-d51f2cc07a7d]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2" returned: 0 in 1.008s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:29 devstack quobyte-client[82407]: System call of process 88954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:11:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2" returned: 1 in 1.541s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:11:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd010ea3-ffba-4e62-86e0-68310b403fe2" returned: 0 in 0.205s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Lock "cinder-quobyte-cd010ea3-ffba-4e62-86e0-68310b403fe2" released by "delete_volume" :: held 3.403s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Created reservations ['fc8061a8-a88d-4ec2-a381-daef451dde7e', '08a2f4d1-23d5-4778-9a5f-485e87c9260e', '58199198-0629-44aa-bb46-bfd02d69c207', '44d3f1e7-0baf-47e5-b6b4-992e96b8fcf4'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.112s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:11:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Deleted volume successfully.
Sep 03 08:11:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-fa67ab06-ddd8-4f00-b4fa-654195d4887a tempest-VolumesImageMetadata-1596118873 None] Lock "cinder-cd010ea3-ffba-4e62-86e0-68310b403fe2-delete_volume" released by "delete_volume" :: held 4.698s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:11:41 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=23,cinder:UPDATE=18,cinder:INSERT=13 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:11:41 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=4,cinder:DELETE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:11:42 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Flow 'volume_create_manager' (3aa81ec0-f7b7-4d29-83f9-d16640e15e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9637882a-dfd8-4aaa-825e-10391c2627b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9637882a-dfd8-4aaa-825e-10391c2627b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1616029585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f37e76-a170-44aa-afd9-527680d21c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793fe7bfcfb548d686f0d5377d8f53c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:11:42Z,use_quota=True,user_id='a086e3477f6e49558facdba52ee79494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957d247-dc86-41e9-a898-6140aece6b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957d247-dc86-41e9-a898-6140aece6b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd8b517-c72c-47a3-ab75-fc6b946f7d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd8b517-c72c-47a3-ab75-fc6b946f7d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f37e76-a170-44aa-afd9-527680d21c26', 'volume_name': 'volume-51f37e76-a170-44aa-afd9-527680d21c26', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a69d6-06b8-46b3-8b21-ad1a7bd44694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a69d6-06b8-46b3-8b21-ad1a7bd44694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729da9c2-cd7d-4765-97e3-2df30d1d46ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:43 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Volume 51f37e76-a170-44aa-afd9-527680d21c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f37e76-a170-44aa-afd9-527680d21c26', 'volume_size': 1}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1616029585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f37e76-a170-44aa-afd9-527680d21c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793fe7bfcfb548d686f0d5377d8f53c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:11:42Z,use_quota=True,user_id='a086e3477f6e49558facdba52ee79494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Creating volume 51f37e76-a170-44aa-afd9-527680d21c26 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:11:43 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:43 devstack quobyte-client[82407]: System call of process 89074 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:11:43 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=54, name=volume-51f37e76-a170-44aa-afd9-527680d21c26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26 1073741824" returned: 0 in 0.482s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26" returned: 0 in 0.263s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] <== create_volume: return (927ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:11:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:11:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729da9c2-cd7d-4765-97e3-2df30d1d46ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f37e76-a170-44aa-afd9-527680d21c26', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73f31a2-324f-42af-9808-81bb784d6fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:44 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Volume volume-51f37e76-a170-44aa-afd9-527680d21c26 (51f37e76-a170-44aa-afd9-527680d21c26): created successfully
Sep 03 08:11:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73f31a2-324f-42af-9808-81bb784d6fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Flow 'volume_create_manager' (3aa81ec0-f7b7-4d29-83f9-d16640e15e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:11:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3be20961-a3c5-4111-9b5c-874ac06b39e8 tempest-AbsoluteLimitsTests-1077461005 None] Created volume successfully.
Sep 03 08:11:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Acquiring lock "cinder-51f37e76-a170-44aa-afd9-527680d21c26-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:11:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Lock "cinder-51f37e76-a170-44aa-afd9-527680d21c26-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:11:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:11:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Acquiring lock "cinder-quobyte-51f37e76-a170-44aa-afd9-527680d21c26" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:11:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Lock "cinder-quobyte-51f37e76-a170-44aa-afd9-527680d21c26" acquired by "delete_volume" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:11:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ab59a-6d53-4a63-ad9c-68e273767a92]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:46 devstack quobyte-client[82407]: System call of process 89087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:11:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26" returned: 0 in 0.639s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-51f37e76-a170-44aa-afd9-527680d21c26" returned: 0 in 0.147s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Lock "cinder-quobyte-51f37e76-a170-44aa-afd9-527680d21c26" released by "delete_volume" :: held 1.030s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Created reservations ['f9bb0a3f-39b1-42fa-947d-1ef37d6fbda8', 'de3732e1-fb92-4230-9bff-0ba8d8eeec19', 'fad0a9bb-11d6-4571-93c3-399110f752d7', '6f25ca7a-a9b2-4fed-9928-c8f2f5d91d3b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.126s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:11:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Deleted volume successfully.
Sep 03 08:11:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5291cbd0-6591-480b-b053-8cd4ce1d3919 tempest-AbsoluteLimitsTests-1077461005 None] Lock "cinder-51f37e76-a170-44aa-afd9-527680d21c26-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.296s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:11:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:11:57 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Flow 'volume_create_manager' (6de90c49-4dc7-4b21-8471-69f801d0692a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ac4e12-44e0-4a7f-8e46-d8a1a0b81afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ac4e12-44e0-4a7f-8e46-d8a1a0b81afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1872094710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97be6b52-5efe-4360-8db6-4260fdb02920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5df5a3b1d99430bb7b7480d0f57c0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:11:57Z,use_quota=True,user_id='1a05fc8305a74b348d98e1b5e4419080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329f9576-6245-4932-9067-d98337610c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329f9576-6245-4932-9067-d98337610c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5b6abb-edcf-428e-bcce-b06ef6123b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5b6abb-edcf-428e-bcce-b06ef6123b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97be6b52-5efe-4360-8db6-4260fdb02920', 'volume_name': 'volume-97be6b52-5efe-4360-8db6-4260fdb02920', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b68f8eb60>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ba9aa0-1ccd-407a-a1f8-c3bb5e195ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ba9aa0-1ccd-407a-a1f8-c3bb5e195ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2689b115-b073-48c6-bc00-538496f5c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:11:57 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Volume 97be6b52-5efe-4360-8db6-4260fdb02920: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97be6b52-5efe-4360-8db6-4260fdb02920', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b68f8eb60>}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Cloning 97be6b52-5efe-4360-8db6-4260fdb02920 from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22  at location (None, None). {{(pid=82397) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}}
Sep 03 08:11:57 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:11:58 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 03 08:11:58 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Image download 20.69 MB at 20.69 MB/s
Sep 03 08:11:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1b77ea-e7dd-4d3e-8888-243288eb2265]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:11:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:11:58 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD
Sep 03 08:11:58 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:12:00 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Sep 03 08:12:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD" returned: 0 in 2.251s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:00 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 is fetched for user 1a05fc8305a74b348d98e1b5e4419080. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 03 08:12:00 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d4e5a-35b1-4a97-b897-4fe3a32cf380]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:01 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD
Sep 03 08:12:01 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:12:03 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD" returned: 0 in 2.701s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1872094710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97be6b52-5efe-4360-8db6-4260fdb02920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5df5a3b1d99430bb7b7480d0f57c0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:11:57Z,use_quota=True,user_id='1a05fc8305a74b348d98e1b5e4419080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Creating volume 97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:12:03 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:12:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:03 devstack quobyte-client[82407]: System call of process 89123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:03 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=55, name=volume-97be6b52-5efe-4360-8db6-4260fdb02920, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 1073741824" returned: 0 in 0.479s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 0 in 0.125s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] <== create_volume: return (743ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Attempting download of 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume 97be6b52-5efe-4360-8db6-4260fdb02920. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b32e7-dbdb-413e-81ec-451d41ea3cec]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_2p229jv_ {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_2p229jv_" returned: 0 in 0.472s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_2p229jv_ {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_2p229jv_" returned: 1 in 0.612s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_2p229jv_' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:12:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bb34ba-4fd1-4e16-9ad4-200289995843]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD" returned: 0 in 0.937s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:07 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] 870a0d94-8d05-4c7b-aab1-1837efb2cb22 was qcow2, converting to raw {{(pid=82397) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 03 08:12:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:07 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=55, name=volume-97be6b52-5efe-4360-8db6-4260fdb02920, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 0 in 1.918s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:09 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_zthsyo5ndevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:12:09 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Converted 112.00 MB image at 57.00 MB/s
Sep 03 08:12:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:09 devstack quobyte-client[82407]: System call of process 89142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 1G" returned: 0 in 0.561s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:09 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c9973b-5974-4c92-8edb-6bbaf651ec74]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 0 in 0.686s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:12:11 devstack quobyte-client[82407]: System call of process 89148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Flow 'volume_create_manager' (d5e6c06f-94b7-4e8a-b7da-9f93710d8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d407d54-b50d-4022-bdae-41dda542051a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d407d54-b50d-4022-bdae-41dda542051a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-108148274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2637a3e-a450-45d1-b773-61c6637f7823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1186038d2fc4491eac72bece1dd320c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:10Z,use_quota=True,user_id='9322a35fed7d433a8d0b4c1568f70e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1766e0c8-5ea1-4990-a26c-aa74714676b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1766e0c8-5ea1-4990-a26c-aa74714676b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e5ae18-d4aa-4ee0-9632-96d927a96590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e5ae18-d4aa-4ee0-9632-96d927a96590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2637a3e-a450-45d1-b773-61c6637f7823', 'volume_name': 'volume-c2637a3e-a450-45d1-b773-61c6637f7823', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d0bb81-f397-4d31-9c75-8bd30910f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d0bb81-f397-4d31-9c75-8bd30910f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2793e6-4c46-4e71-a981-caabab8831d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:11 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume c2637a3e-a450-45d1-b773-61c6637f7823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2637a3e-a450-45d1-b773-61c6637f7823', 'volume_size': 1}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-108148274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2637a3e-a450-45d1-b773-61c6637f7823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1186038d2fc4491eac72bece1dd320c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:10Z,use_quota=True,user_id='9322a35fed7d433a8d0b4c1568f70e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Creating volume c2637a3e-a450-45d1-b773-61c6637f7823 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:12:11 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 1 in 1.198s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:11 devstack quobyte-client[82407]: System call of process 89155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Downloaded image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume 97be6b52-5efe-4360-8db6-4260fdb02920 successfully. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 for user 1a05fc8305a74b348d98e1b5e4419080 is deleted. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 03 08:12:11 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=56, name=volume-c2637a3e-a450-45d1-b773-61c6637f7823, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:11 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Marking volume 97be6b52-5efe-4360-8db6-4260fdb02920 as bootable. {{(pid=82397) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Copying metadata from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 to 97be6b52-5efe-4360-8db6-4260fdb02920. {{(pid=82397) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Creating volume glance metadata for volume 97be6b52-5efe-4360-8db6-4260fdb02920 backed by image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82397) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823 1073741824" returned: 0 in 0.566s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823" returned: 0 in 0.272s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] <== create_volume: return (888ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2793e6-4c46-4e71-a981-caabab8831d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2637a3e-a450-45d1-b773-61c6637f7823', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06fe417-3ea0-4b85-b0f8-420be5588d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:12 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume volume-c2637a3e-a450-45d1-b773-61c6637f7823 (c2637a3e-a450-45d1-b773-61c6637f7823): created successfully
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06fe417-3ea0-4b85-b0f8-420be5588d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Flow 'volume_create_manager' (d5e6c06f-94b7-4e8a-b7da-9f93710d8cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2689b115-b073-48c6-bc00-538496f5c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97be6b52-5efe-4360-8db6-4260fdb02920', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b68f8eb60>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8daa1c-5f7e-49d7-bccb-b39df3a09d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b45ed3d6-9b6a-4221-bdd0-1c3448ddcf3c tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Created volume successfully.
Sep 03 08:12:12 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Volume volume-97be6b52-5efe-4360-8db6-4260fdb02920 (97be6b52-5efe-4360-8db6-4260fdb02920): created successfully
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8daa1c-5f7e-49d7-bccb-b39df3a09d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Flow 'volume_create_manager' (6de90c49-4dc7-4b21-8471-69f801d0692a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-068cc2af-c045-4e8d-b83a-c12504e6eeec tempest-VolumesExtendTest-697716890 None] Created volume successfully.
Sep 03 08:12:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:13 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b990aaa-56e7-467c-8dd2-6d2b11a7e78a]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:15 devstack quobyte-client[82407]: System call of process 89168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:15 devstack quobyte-client[82407]: System call of process 89168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 0 in 1.207s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 1 in 0.495s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:12:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 2G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 2G" returned: 0 in 0.164s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.116s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:16 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-89e1d702-8360-43db-bf22-c6ee3695b2b3 tempest-VolumesExtendTest-697716890 None] Extend volume completed successfully.
Sep 03 08:12:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Acquiring lock "cinder-97be6b52-5efe-4360-8db6-4260fdb02920-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Lock "cinder-97be6b52-5efe-4360-8db6-4260fdb02920-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:17 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Acquiring lock "cinder-quobyte-97be6b52-5efe-4360-8db6-4260fdb02920" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-97be6b52-5efe-4360-8db6-4260fdb02920" acquired by "delete_volume" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:17 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[75781e23-6d03-4de0-a206-77b8f2ed4a4c]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 0 in 0.643s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f965248-ce0b-4578-ae28-aaf4c043ef71]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 1 in 0.812s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-97be6b52-5efe-4360-8db6-4260fdb02920" returned: 0 in 0.148s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-97be6b52-5efe-4360-8db6-4260fdb02920" released by "delete_volume" :: held 1.946s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:19 devstack quobyte-client[82407]: System call of process 89191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823" returned: 0 in 0.859s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:19 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Created reservations ['315ea48b-6cdf-4881-8959-22a6b3b183c1', '2e5fafb3-f3e2-4936-a333-40f34ae5d411', 'c587857c-5a41-48a7-9bde-54899fe7ba8d', '88f0b510-f080-4182-9678-03b67089a0a7'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-c2637a3e-a450-45d1-b773-61c6637f7823', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9830f0c0-9cfe-4a83-8f83-fe1bb2cd3f17', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:12:20 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.356s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:12:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Deleted volume successfully.
Sep 03 08:12:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-cc133515-12c3-4348-a4d9-0077876141b5 req-d75203ac-cc69-414d-b509-cfd33316bdab tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] attachment_update completed successfully.
Sep 03 08:12:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-73570722-a8b4-493e-a6f2-c7d2f5dbbe5b tempest-VolumesExtendTest-697716890 None] Lock "cinder-97be6b52-5efe-4360-8db6-4260fdb02920-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:21 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Flow 'volume_create_manager' (a0abf5c0-57ab-4c67-9556-a7f816a3da49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742043cb-2754-412b-a2af-c59807a32b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742043cb-2754-412b-a2af-c59807a32b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1420956673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c64cc0-e4c5-49a1-b156-f6c5cac197ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5df5a3b1d99430bb7b7480d0f57c0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:21Z,use_quota=True,user_id='1a05fc8305a74b348d98e1b5e4419080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d540487c-ddcf-40d3-a82f-4b13df480829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d540487c-ddcf-40d3-a82f-4b13df480829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce14d38-c32b-4c3b-b1d4-ed7d5e34b9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce14d38-c32b-4c3b-b1d4-ed7d5e34b9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c64cc0-e4c5-49a1-b156-f6c5cac197ba', 'volume_name': 'volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66be888-4b21-49cc-b106-ac9334b6c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66be888-4b21-49cc-b106-ac9334b6c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5868c4bc-4177-479a-a595-ba9b76a3d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:21 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Volume 28c64cc0-e4c5-49a1-b156-f6c5cac197ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba', 'volume_size': 1}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1420956673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c64cc0-e4c5-49a1-b156-f6c5cac197ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5df5a3b1d99430bb7b7480d0f57c0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:21Z,use_quota=True,user_id='1a05fc8305a74b348d98e1b5e4419080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Creating volume 28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:12:21 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:12:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:22 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=57, name=volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba 1073741824" returned: 0 in 0.354s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] <== create_volume: return (508ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.522s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5868c4bc-4177-479a-a595-ba9b76a3d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de15c9c9-e129-46d2-bb60-c834dbdea157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Volume volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba (28c64cc0-e4c5-49a1-b156-f6c5cac197ba): created successfully
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de15c9c9-e129-46d2-bb60-c834dbdea157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Flow 'volume_create_manager' (a0abf5c0-57ab-4c67-9556-a7f816a3da49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:22 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-97cdbfd6-644c-4ad4-b7e2-661e3a35e050 tempest-VolumesExtendTest-697716890 None] Created volume successfully.
Sep 03 08:12:24 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Creating offline snapshot 47807a9d-8332-4b08-9393-b42ae09e8219 of volume 28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:12:24 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dab3af-aae6-43ba-bf65-9b3b398b6d05]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" returned: 0 in 0.529s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=58, name=volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 1G" returned: 0 in 0.288s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img rebase -u -b volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:25 devstack quobyte-client[82407]: System call of process 89633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] CMD "qemu-img rebase -u -b volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219" returned: 0 in 0.166s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219" returned: 0 in 0.098s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219" returned: 0 in 0.083s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.info" returned: 0 in 0.088s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:12:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.info" returned: 0 in 0.129s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-022b2279-74f5-4c44-8c6d-3b0913c699fd tempest-VolumesExtendTest-697716890 None] Create snapshot completed successfully
Sep 03 08:12:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:27 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f0da94-d989-429b-9331-70a9eefbc35d]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" returned: 0 in 0.515s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 2G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:28 devstack quobyte-client[82407]: System call of process 89643 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 2G" returned: 0 in 0.380s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.061s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f5eea556-81af-4310-b901-fd40ff2fb351 tempest-VolumesExtendTest-697716890 None] Extend volume completed successfully.
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Acquiring lock "cinder-47807a9d-8332-4b08-9393-b42ae09e8219-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Lock "cinder-47807a9d-8332-4b08-9393-b42ae09e8219-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Acquiring lock "cinder-quobyte-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Acquiring lock "cinder-quobyte-47807a9d-8332-4b08-9393-b42ae09e8219" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-47807a9d-8332-4b08-9393-b42ae09e8219" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Deleting offline snapshot 47807a9d-8332-4b08-9393-b42ae09e8219 of volume 28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] snapshot_file for this snap is: volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe2669e-813d-44fd-8b06-34f06f196a64]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:30 devstack quobyte-client[82407]: System call of process 89646 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219" returned: 0 in 0.758s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:12:31 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd814227-5712-4af2-81d2-e025aaa3e40b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" returned: 0 in 1.003s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219" returned: 0 in 0.363s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba.47807a9d-8332-4b08-9393-b42ae09e8219" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-47807a9d-8332-4b08-9393-b42ae09e8219" released by "_delete_snapshot" :: held 2.590s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" released by "delete_snapshot" :: held 2.611s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Created reservations ['5c93c963-d439-4518-bb7e-c23e86f43bf4', '26a010af-d255-4a5d-8f5d-a2d0a462ec50', '65db54e9-7f2d-4579-a5f0-424d3d425b41', '7c5a2ee3-a4d3-42e2-ac48-635ea7d46543'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:12:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Delete snapshot completed successfully.
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-240f66f9-c339-47f6-9834-7928618cba38 tempest-VolumesExtendTest-697716890 None] Lock "cinder-47807a9d-8332-4b08-9393-b42ae09e8219-delete_snapshot" released by "delete_snapshot" :: held 3.062s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Acquiring lock "cinder-28c64cc0-e4c5-49a1-b156-f6c5cac197ba-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Lock "cinder-28c64cc0-e4c5-49a1-b156-f6c5cac197ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Acquiring lock "cinder-quobyte-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b47b67-af3a-49fa-878c-2685eab749de]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" returned: 0 in 0.403s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" returned: 0 in 0.091s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Lock "cinder-quobyte-28c64cc0-e4c5-49a1-b156-f6c5cac197ba" released by "delete_volume" :: held 0.635s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Created reservations ['ef8f4384-051e-417f-8f3e-d2bf5e9db15f', 'fbed8358-31a0-425f-83c9-11867db9c493', '0e950928-c2e1-443c-a777-f1d361683f61', 'cc9950da-df56-4242-b9f2-c8d13fe486ae'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.107s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:34 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:12:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Deleted volume successfully.
Sep 03 08:12:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-74dc80d5-30d2-4cf0-b333-a74a0d8f5f5f tempest-VolumesExtendTest-697716890 None] Lock "cinder-28c64cc0-e4c5-49a1-b156-f6c5cac197ba-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:40 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Flow 'volume_create_manager' (aba90e33-7cab-4a50-809a-e96e2b2aeae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66ae78-f95b-4a3f-9259-d6e0193e7fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66ae78-f95b-4a3f-9259-d6e0193e7fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1841244947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30789291-9f12-4ebe-ae99-7f5de7f758a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a63db7a73f4c27aad308e96c483203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:41Z,use_quota=True,user_id='cdc2f5e1ddd644b4823b1e8931c85c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769ca01e-6dda-4f09-9894-6ff39c4bf30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769ca01e-6dda-4f09-9894-6ff39c4bf30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373f2eaf-01e3-46f6-8402-9cf4692ed12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373f2eaf-01e3-46f6-8402-9cf4692ed12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30789291-9f12-4ebe-ae99-7f5de7f758a5', 'volume_name': 'volume-30789291-9f12-4ebe-ae99-7f5de7f758a5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e438175-945f-4618-8cff-6648386f2ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e438175-945f-4618-8cff-6648386f2ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e743fd16-7d90-49ba-a625-d682fd2daa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:40 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Volume 30789291-9f12-4ebe-ae99-7f5de7f758a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30789291-9f12-4ebe-ae99-7f5de7f758a5', 'volume_size': 1}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1841244947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30789291-9f12-4ebe-ae99-7f5de7f758a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a63db7a73f4c27aad308e96c483203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:41Z,use_quota=True,user_id='cdc2f5e1ddd644b4823b1e8931c85c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Creating volume 30789291-9f12-4ebe-ae99-7f5de7f758a5 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:12:40 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:12:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:41 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=60, name=volume-30789291-9f12-4ebe-ae99-7f5de7f758a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5 1073741824" returned: 0 in 0.403s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5" returned: 0 in 0.087s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.579s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=57,cinder:SELECT=46,cinder:INSERT=16,cinder:DELETE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e743fd16-7d90-49ba-a625-d682fd2daa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30789291-9f12-4ebe-ae99-7f5de7f758a5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bbec7e-eca2-4334-a44b-5be95cdc85aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:41 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Volume volume-30789291-9f12-4ebe-ae99-7f5de7f758a5 (30789291-9f12-4ebe-ae99-7f5de7f758a5): created successfully
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bbec7e-eca2-4334-a44b-5be95cdc85aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Flow 'volume_create_manager' (aba90e33-7cab-4a50-809a-e96e2b2aeae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:41 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-faefc816-bfeb-43ae-b1f7-a2afaa7ace89 tempest-VolumesListTestJSON-204774651 None] Created volume successfully.
Sep 03 08:12:43 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Flow 'volume_create_manager' (529f46f3-ea88-40da-b4ec-7465a029f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e6e36-d546-48fa-ae15-0d3a25fa084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e6e36-d546-48fa-ae15-0d3a25fa084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-600543919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d567c6c8-f5d4-4184-9b8a-44778c944476,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a63db7a73f4c27aad308e96c483203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:43Z,use_quota=True,user_id='cdc2f5e1ddd644b4823b1e8931c85c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e24604-10cd-4235-b9ee-c37186618e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e24604-10cd-4235-b9ee-c37186618e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf13e695-0c96-4adf-9678-8ac86e157758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf13e695-0c96-4adf-9678-8ac86e157758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd567c6c8-f5d4-4184-9b8a-44778c944476', 'volume_name': 'volume-d567c6c8-f5d4-4184-9b8a-44778c944476', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3825ea7-9d12-43cb-b9e5-7f374a68530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3825ea7-9d12-43cb-b9e5-7f374a68530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbb30a9-3304-4b80-9889-b7fdd58a59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:43 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Volume d567c6c8-f5d4-4184-9b8a-44778c944476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d567c6c8-f5d4-4184-9b8a-44778c944476', 'volume_size': 1}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-600543919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d567c6c8-f5d4-4184-9b8a-44778c944476,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a63db7a73f4c27aad308e96c483203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:43Z,use_quota=True,user_id='cdc2f5e1ddd644b4823b1e8931c85c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Creating volume d567c6c8-f5d4-4184-9b8a-44778c944476 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:12:43 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:43 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=61, name=volume-d567c6c8-f5d4-4184-9b8a-44778c944476, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476 1073741824" returned: 0 in 0.373s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:12:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.555s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbb30a9-3304-4b80-9889-b7fdd58a59de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d567c6c8-f5d4-4184-9b8a-44778c944476', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08fce9c-2064-41bc-9948-48adfab69960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:44 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Volume volume-d567c6c8-f5d4-4184-9b8a-44778c944476 (d567c6c8-f5d4-4184-9b8a-44778c944476): created successfully
Sep 03 08:12:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08fce9c-2064-41bc-9948-48adfab69960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Flow 'volume_create_manager' (529f46f3-ea88-40da-b4ec-7465a029f537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c308cef6-2faf-4fc3-9292-95f477773981 tempest-VolumesListTestJSON-204774651 None] Created volume successfully.
Sep 03 08:12:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Flow 'volume_create_manager' (50d86e70-5805-4101-bc0f-f5ad8573724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387978f7-2437-4610-907f-88cfdefd19f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387978f7-2437-4610-907f-88cfdefd19f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1156172251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75268b9e-05cd-470c-a613-3235809232c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a63db7a73f4c27aad308e96c483203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:46Z,use_quota=True,user_id='cdc2f5e1ddd644b4823b1e8931c85c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f8af1a-69f8-4a8d-9050-05b561a23db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f8af1a-69f8-4a8d-9050-05b561a23db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6289a724-cd41-4cbc-a27e-d46a663324df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6289a724-cd41-4cbc-a27e-d46a663324df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75268b9e-05cd-470c-a613-3235809232c8', 'volume_name': 'volume-75268b9e-05cd-470c-a613-3235809232c8', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53888204-7931-4e12-be0a-7b1968e3e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53888204-7931-4e12-be0a-7b1968e3e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759ae034-1413-439a-8d43-b0cec0c62c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:46 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Volume 75268b9e-05cd-470c-a613-3235809232c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75268b9e-05cd-470c-a613-3235809232c8', 'volume_size': 1}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1156172251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75268b9e-05cd-470c-a613-3235809232c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a63db7a73f4c27aad308e96c483203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:46Z,use_quota=True,user_id='cdc2f5e1ddd644b4823b1e8931c85c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Creating volume 75268b9e-05cd-470c-a613-3235809232c8 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:12:46 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:46 devstack quobyte-client[82407]: System call of process 89769 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:12:46 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=62, name=volume-75268b9e-05cd-470c-a613-3235809232c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8 1073741824" returned: 0 in 0.345s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8" returned: 0 in 0.090s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] <== create_volume: return (499ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.511s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759ae034-1413-439a-8d43-b0cec0c62c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75268b9e-05cd-470c-a613-3235809232c8', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbdc9cf-7d00-4071-b7b4-2cf5de852458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:47 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Volume volume-75268b9e-05cd-470c-a613-3235809232c8 (75268b9e-05cd-470c-a613-3235809232c8): created successfully
Sep 03 08:12:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbdc9cf-7d00-4071-b7b4-2cf5de852458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Flow 'volume_create_manager' (50d86e70-5805-4101-bc0f-f5ad8573724f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-fadb4c04-cdf8-4a07-bb97-a0391c9c4f72 tempest-VolumesListTestJSON-204774651 None] Created volume successfully.
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.129s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:12:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "cinder-75268b9e-05cd-470c-a613-3235809232c8-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-75268b9e-05cd-470c-a613-3235809232c8-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "cinder-quobyte-75268b9e-05cd-470c-a613-3235809232c8" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-1a3c54e1-6868-48f8-88c4-74e602197fc9 req-5734487f-fff6-478b-b03c-3ad792ea90e8 tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-quobyte-75268b9e-05cd-470c-a613-3235809232c8" acquired by "delete_volume" :: waited 0.057s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:52 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2905325-c0a2-4d7f-823b-6c420399cdaf]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-1a3c54e1-6868-48f8-88c4-74e602197fc9 req-5734487f-fff6-478b-b03c-3ad792ea90e8 tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-1a3c54e1-6868-48f8-88c4-74e602197fc9 req-5734487f-fff6-478b-b03c-3ad792ea90e8 tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Terminate volume connection completed successfully.
Sep 03 08:12:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-1a3c54e1-6868-48f8-88c4-74e602197fc9 req-5734487f-fff6-478b-b03c-3ad792ea90e8 tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Deleting attachment 9830f0c0-9cfe-4a83-8f83-fe1bb2cd3f17. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8" returned: 0 in 0.544s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-75268b9e-05cd-470c-a613-3235809232c8" returned: 0 in 0.093s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-quobyte-75268b9e-05cd-470c-a613-3235809232c8" released by "delete_volume" :: held 0.801s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Created reservations ['58ebdcfa-92af-483d-84b7-385456996748', '8d4a84cf-f9d7-4237-baf9-8f722bd76b43', '3f5b6572-1acd-4ee1-8d45-d7b1cd541cd0', 'f5df5aa2-70dc-44fe-86ee-ba5539025dbc'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.109s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:12:54 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Deleted volume successfully.
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Acquiring lock "cinder-c2637a3e-a450-45d1-b773-61c6637f7823-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-00afe61e-0aa6-4709-8313-8492479ee701 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-75268b9e-05cd-470c-a613-3235809232c8-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "cinder-c2637a3e-a450-45d1-b773-61c6637f7823-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Acquiring lock "cinder-quobyte-c2637a3e-a450-45d1-b773-61c6637f7823" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "cinder-quobyte-c2637a3e-a450-45d1-b773-61c6637f7823" acquired by "delete_volume" :: waited 0.019s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a5b85b-dbfd-4ac7-b0d0-2645ac92017a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "cinder-d567c6c8-f5d4-4184-9b8a-44778c944476-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-d567c6c8-f5d4-4184-9b8a-44778c944476-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "cinder-quobyte-d567c6c8-f5d4-4184-9b8a-44778c944476" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-quobyte-d567c6c8-f5d4-4184-9b8a-44778c944476" acquired by "delete_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb2eb4-279f-4c43-ad45-1d16fb215bef]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823" returned: 0 in 1.346s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Flow 'volume_create_manager' (8c2a0db0-1532-4573-9c78-2f4b205465ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700e7a19-1da3-4169-9013-be81a7b5dbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c2637a3e-a450-45d1-b773-61c6637f7823" returned: 0 in 0.558s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476" returned: 0 in 1.062s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "cinder-quobyte-c2637a3e-a450-45d1-b773-61c6637f7823" released by "delete_volume" :: held 2.170s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700e7a19-1da3-4169-9013-be81a7b5dbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-188896638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e358b1a-b12e-40f1-a7de-59ededdaab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3071dbf2b91d45d594825d370a341d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:55Z,use_quota=True,user_id='c8f00ae1eb074b73bddc8dadff794e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995e5412-bfd2-416d-b09f-589ea1bcba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995e5412-bfd2-416d-b09f-589ea1bcba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26458d1c-2453-4232-8508-92eaf9d403f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26458d1c-2453-4232-8508-92eaf9d403f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e358b1a-b12e-40f1-a7de-59ededdaab37', 'volume_name': 'volume-9e358b1a-b12e-40f1-a7de-59ededdaab37', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986a77f0-4580-46a0-a992-584c76f62efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986a77f0-4580-46a0-a992-584c76f62efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8046517f-8bc3-42f5-bdad-d79dd52d32f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:56 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Volume 9e358b1a-b12e-40f1-a7de-59ededdaab37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e358b1a-b12e-40f1-a7de-59ededdaab37', 'volume_size': 1}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-188896638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e358b1a-b12e-40f1-a7de-59ededdaab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3071dbf2b91d45d594825d370a341d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:12:55Z,use_quota=True,user_id='c8f00ae1eb074b73bddc8dadff794e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Creating volume 9e358b1a-b12e-40f1-a7de-59ededdaab37 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:12:57 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:57 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=63, name=volume-9e358b1a-b12e-40f1-a7de-59ededdaab37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d567c6c8-f5d4-4184-9b8a-44778c944476" returned: 0 in 0.721s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-quobyte-d567c6c8-f5d4-4184-9b8a-44778c944476" released by "delete_volume" :: held 1.954s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37 1073741824" returned: 0 in 0.477s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37" returned: 0 in 0.395s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] <== create_volume: return (917ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:57 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=51,cinder:UPDATE=50,cinder:INSERT=18,cinder:DELETE=5 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8046517f-8bc3-42f5-bdad-d79dd52d32f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e358b1a-b12e-40f1-a7de-59ededdaab37', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2d4826-65b1-4f55-9e3f-6d5a2b57bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Created reservations ['1138750a-e7d3-4d90-b35c-9b0c2a1890e0', 'e28cb893-86f4-458e-b6b4-9a3ac66ecb2a', '94075d39-4cb5-4322-b5de-fa7a4a4a6e7a', 'd3f81bac-5c9a-45dc-9f7c-f538dc838cdc'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:12:58 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Volume volume-9e358b1a-b12e-40f1-a7de-59ededdaab37 (9e358b1a-b12e-40f1-a7de-59ededdaab37): created successfully
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2d4826-65b1-4f55-9e3f-6d5a2b57bcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Flow 'volume_create_manager' (8c2a0db0-1532-4573-9c78-2f4b205465ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Created reservations ['c561d2b4-6564-4935-857b-87a4c4b6a163', 'f34ed252-a0c9-4433-9cf7-ceabd18706a8', 'ff5301ac-78da-41aa-a058-3ac45a90526a', '39b364f0-8124-40ee-82c0-529ffdfcf33e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:12:58 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f3c574de-9bb5-41cd-92f0-328d81a39d0a tempest-AttachVolumeTestJSON-1596917585 None] Created volume successfully.
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.197s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:12:58 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Deleted volume successfully.
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:12:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ce91dd33-bc82-4511-8270-454d033b660d tempest-TestServerVolumeAttachScenarioOldVersion-97443654 None] Lock "cinder-c2637a3e-a450-45d1-b773-61c6637f7823-delete_volume" released by "delete_volume" :: held 4.680s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.479s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:12:59 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Deleted volume successfully.
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Acquiring lock "cinder-30789291-9f12-4ebe-ae99-7f5de7f758a5-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6304dc67-7e97-4a15-93a7-5e5ec10a3510 tempest-VolumesListTestJSON-204774651 None] Lock "cinder-d567c6c8-f5d4-4184-9b8a-44778c944476-delete_volume" released by "delete_volume" :: held 4.638s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Lock "cinder-30789291-9f12-4ebe-ae99-7f5de7f758a5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:59 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Acquiring lock "cinder-quobyte-30789291-9f12-4ebe-ae99-7f5de7f758a5" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Lock "cinder-quobyte-30789291-9f12-4ebe-ae99-7f5de7f758a5" acquired by "delete_volume" :: waited 0.026s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23e50fa-36f8-4ec7-8342-18eff8ea0f8e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:12:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:13:00 devstack quobyte-client[82407]: System call of process 89802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:13:00 devstack quobyte-client[82407]: System call of process 89802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:13:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5" returned: 0 in 0.883s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:13:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:13:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30789291-9f12-4ebe-ae99-7f5de7f758a5" returned: 0 in 0.469s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:13:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Lock "cinder-quobyte-30789291-9f12-4ebe-ae99-7f5de7f758a5" released by "delete_volume" :: held 2.217s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:13:02 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Created reservations ['8a88a935-06fc-4c2d-9c38-7efba8dd725f', 'd17528e4-70c4-42ca-9630-63f14aa0d0d5', '65ca5d9d-7b33-44ec-b299-c4e90cde0950', 'f0db0c53-d5c3-477a-b715-dff55ebaefb5'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:13:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:13:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:13:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:13:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:13:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:13:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:13:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.218s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:13:03 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:13:03 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Deleted volume successfully.
Sep 03 08:13:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2d94ece5-d10b-47d2-a8d3-c298896187eb tempest-VolumesListTestJSON-204774651 None] Lock "cinder-30789291-9f12-4ebe-ae99-7f5de7f758a5-delete_volume" released by "delete_volume" :: held 4.482s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:13:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:13:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:13:04 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b85670b-8c55-4ee0-8c0b-1d4b9bdf0dab]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:13:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:13:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37" returned: 0 in 0.695s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:13:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:13:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-9e358b1a-b12e-40f1-a7de-59ededdaab37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f91ea51a-f0ae-4afd-b78f-0001ceac7a1e', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:13:05 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:13:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-82629db0-9ad7-4f83-ba25-7ec4eea778ab req-122b7d33-8cb8-497b-9348-b1353a0733fe tempest-AttachVolumeTestJSON-1596917585 None] attachment_update completed successfully.
Sep 03 08:13:09 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Flow 'volume_create_manager' (a2bae716-4693-4fbe-9e26-fa75fe581647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4ff47b-5bd5-415b-90a3-6d457bda0527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4ff47b-5bd5-415b-90a3-6d457bda0527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1367045376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c83e05-39d3-4242-88c0-f2c9149497d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5c010e89cb457a8131f709c339b682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:13:09Z,use_quota=True,user_id='7570898592994d53bfa584502fe86f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925a64e6-c273-42df-b1cd-4637bceb6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925a64e6-c273-42df-b1cd-4637bceb6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c21c257-52cb-4812-a736-c8fdfce3ac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c21c257-52cb-4812-a736-c8fdfce3ac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c83e05-39d3-4242-88c0-f2c9149497d3', 'volume_name': 'volume-a2c83e05-39d3-4242-88c0-f2c9149497d3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92461a44-689b-4441-8377-defe7ec03852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92461a44-689b-4441-8377-defe7ec03852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3be343-171f-49e6-86e7-88cae38fccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:13:09 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Volume a2c83e05-39d3-4242-88c0-f2c9149497d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c83e05-39d3-4242-88c0-f2c9149497d3', 'volume_size': 1}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1367045376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c83e05-39d3-4242-88c0-f2c9149497d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5c010e89cb457a8131f709c339b682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:13:09Z,use_quota=True,user_id='7570898592994d53bfa584502fe86f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Creating volume a2c83e05-39d3-4242-88c0-f2c9149497d3 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:13:09 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:13:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:13:09 devstack quobyte-client[82407]: System call of process 90247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:13:09 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=64, name=volume-a2c83e05-39d3-4242-88c0-f2c9149497d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3 1073741824" returned: 0 in 0.525s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3" returned: 0 in 0.224s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] <== create_volume: return (878ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3be343-171f-49e6-86e7-88cae38fccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c83e05-39d3-4242-88c0-f2c9149497d3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af10248f-f4bc-42d4-a0b3-0944930a94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:13:10 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Volume volume-a2c83e05-39d3-4242-88c0-f2c9149497d3 (a2c83e05-39d3-4242-88c0-f2c9149497d3): created successfully
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af10248f-f4bc-42d4-a0b3-0944930a94ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:13:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Flow 'volume_create_manager' (a2bae716-4693-4fbe-9e26-fa75fe581647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:13:10 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-1190bcc4-04d6-4a73-9352-2fcc327fe3ea tempest-VolumesNegativeTest-1970340271 None] Created volume successfully.
Sep 03 08:13:20 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=29,cinder:UPDATE=52,cinder:DELETE=7,cinder:INSERT=11 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:13:20 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=16,cinder:SELECT=15,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.527s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:13:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:14:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Acquiring lock "cinder-a2c83e05-39d3-4242-88c0-f2c9149497d3-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Lock "cinder-a2c83e05-39d3-4242-88c0-f2c9149497d3-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:12 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Acquiring lock "cinder-quobyte-a2c83e05-39d3-4242-88c0-f2c9149497d3" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Lock "cinder-quobyte-a2c83e05-39d3-4242-88c0-f2c9149497d3" acquired by "delete_volume" :: waited 0.042s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:12 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6190c84e-c409-4f2a-a368-a2673a7bcbcb]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:13 devstack quobyte-client[82407]: System call of process 91020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3" returned: 0 in 1.331s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a2c83e05-39d3-4242-88c0-f2c9149497d3" returned: 0 in 0.140s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Lock "cinder-quobyte-a2c83e05-39d3-4242-88c0-f2c9149497d3" released by "delete_volume" :: held 1.918s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Created reservations ['b3f0d74c-79d6-4b75-8fb0-fc9610c689ee', '2cd79112-e07e-4cd1-8fb4-2e823f19619b', '976f0c1d-9c54-4940-8ba1-df65024e48ca', 'cea77ea8-7b76-48be-9da0-b55227209557'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.310s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:15 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:14:15 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Deleted volume successfully.
Sep 03 08:14:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7c282f8e-f72a-4c37-8d73-ff9663cfa91d tempest-VolumesNegativeTest-1970340271 None] Lock "cinder-a2c83e05-39d3-4242-88c0-f2c9149497d3-delete_volume" released by "delete_volume" :: held 4.192s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Flow 'volume_create_manager' (49b9f185-6aba-4a51-a8d0-81d838355589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94b7115-0f38-4eaa-b081-b0793adeb370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94b7115-0f38-4eaa-b081-b0793adeb370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-908271092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f26750-c1c7-4341-b82a-0a6ebfe06d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275936d64cf7451c90d92a7b82f4cee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:14:22Z,use_quota=True,user_id='2da27d50f6e349d99a0ba595214d55cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5c0bd1-614e-4e22-949d-210b3b1355f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5c0bd1-614e-4e22-949d-210b3b1355f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabadba3-e25a-43a7-9743-30318b7cdb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabadba3-e25a-43a7-9743-30318b7cdb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f26750-c1c7-4341-b82a-0a6ebfe06d2b', 'volume_name': 'volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3d1829-e86f-4a5c-94da-c69bb80723ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3d1829-e86f-4a5c-94da-c69bb80723ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc14a5c-6ddb-484b-9354-ea3a39d55e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b', 'volume_size': 1}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-908271092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f26750-c1c7-4341-b82a-0a6ebfe06d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275936d64cf7451c90d92a7b82f4cee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:14:22Z,use_quota=True,user_id='2da27d50f6e349d99a0ba595214d55cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Creating volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:14:22 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:22 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=65, name=volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b 1073741824" returned: 0 in 0.597s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" returned: 0 in 0.162s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] <== create_volume: return (861ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:14:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc14a5c-6ddb-484b-9354-ea3a39d55e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f5e82b-aec4-4152-a5bf-e4819b9dbf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Volume volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b (27f26750-c1c7-4341-b82a-0a6ebfe06d2b): created successfully
Sep 03 08:14:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f5e82b-aec4-4152-a5bf-e4819b9dbf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Flow 'volume_create_manager' (49b9f185-6aba-4a51-a8d0-81d838355589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:14:23 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c1109f6c-5c44-44ec-82f4-1d0585fc8197 tempest-VolumesSnapshotListTestJSON-623719359 None] Created volume successfully.
Sep 03 08:14:24 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Creating offline snapshot aafd967d-30e1-473b-b361-6b522f993856 of volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:14:24 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7e5417-f6e1-48fb-b4fe-83a9f5884ae5]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" returned: 0 in 0.604s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=66, name=volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:14:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 1G" returned: 0 in 0.424s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:25 devstack quobyte-client[82407]: System call of process 91053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img rebase -u -b volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.228s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.200s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.153s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.info" returned: 0 in 0.251s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.info" returned: 0 in 0.128s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:27 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-60ee7274-9aea-46fa-9baf-9e7adc273977 tempest-VolumesSnapshotListTestJSON-623719359 None] Create snapshot completed successfully
Sep 03 08:14:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Creating offline snapshot a7706b84-7071-4a5c-9d64-39deacdc44f0 of volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:14:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fae8ec-cede-4eb4-a356-c62a623078f1]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.506s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:14:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:28 devstack quobyte-client[82407]: System call of process 91063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:29 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=68, name=volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 1G" returned: 0 in 0.548s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:29 devstack quobyte-client[82407]: System call of process 91066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img rebase -u -b volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.178s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.099s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.119s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:30 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2d7c9b47-807a-4da8-802c-16abfa43702e tempest-VolumesSnapshotListTestJSON-623719359 None] Create snapshot completed successfully
Sep 03 08:14:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Creating offline snapshot 24c5a8b5-01a1-40b7-9e77-47a16a5f64aa of volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:14:30 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed70b6-6ca8-4186-ace8-93abf37f4b22]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.453s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:31 devstack quobyte-client[82407]: System call of process 91074 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:31 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=69, name=volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa 1G" returned: 0 in 0.420s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:31 devstack quobyte-client[82407]: System call of process 91078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img rebase -u -b volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" returned: 0 in 0.396s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:14:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Flow 'volume_create_manager' (28dc339e-aa82-4fd0-ab36-d416ab58a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399d5c50-8fc6-455c-8eaf-7c5c8fd817b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399d5c50-8fc6-455c-8eaf-7c5c8fd817b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2054319617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7690a1-98ae-4312-aa6f-a43624fa2c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d175bcba654467f84204a2c4f668710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:14:31Z,use_quota=True,user_id='118e1a876b994bdf9ed339dd9d7dafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c2ae0e-c1a4-4a45-baef-edb67ef10699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c2ae0e-c1a4-4a45-baef-edb67ef10699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cd643b-8abf-497c-830a-042c7ffba86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" returned: 0 in 0.444s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" returned: 0 in 0.170s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f612c40f-a25d-43b7-bb62-e8ed81cc18f6 tempest-VolumesSnapshotListTestJSON-623719359 None] Create snapshot completed successfully
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cd643b-8abf-497c-830a-042c7ffba86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c7690a1-98ae-4312-aa6f-a43624fa2c1a', 'volume_name': 'volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5ed16260>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7854b8-cc88-4bb8-9d6b-d6c543b47047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7854b8-cc88-4bb8-9d6b-d6c543b47047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b5d204-4c3c-449a-abb3-8c7c0e1e3325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:32 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Volume 8c7690a1-98ae-4312-aa6f-a43624fa2c1a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5ed16260>}
Sep 03 08:14:32 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Cloning 8c7690a1-98ae-4312-aa6f-a43624fa2c1a from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22  at location (None, None). {{(pid=82397) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}}
Sep 03 08:14:33 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 03 08:14:33 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Image download 20.69 MB at 20.69 MB/s
Sep 03 08:14:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57edc67-8ad5-46c5-8ca3-e8a4762eccad]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:33 devstack sudo[91085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD
Sep 03 08:14:33 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-24c5a8b5-01a1-40b7-9e77-47a16a5f64aa-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-24c5a8b5-01a1-40b7-9e77-47a16a5f64aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.124s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:35 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-quobyte-24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Deleting offline snapshot 24c5a8b5-01a1-40b7-9e77-47a16a5f64aa of volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] snapshot_file for this snap is: volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af60da-c91f-433f-a2df-2235d0845a8a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:36 devstack quobyte-client[82407]: System call of process 91119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" returned: 0 in 0.847s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:14:36 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[627301a0-ad20-4788-adaa-842d50466aa0]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:36 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root
Sep 03 08:14:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD" returned: 0 in 3.557s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:36 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 is fetched for user 118e1a876b994bdf9ed339dd9d7dafcc. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 03 08:14:37 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9966d05-6d11-4df5-a880-29562e98c4ae]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.683s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:14:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" returned: 0 in 0.368s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:37 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD
Sep 03 08:14:37 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" returned: 0 in 0.156s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-24c5a8b5-01a1-40b7-9e77-47a16a5f64aa" released by "_delete_snapshot" :: held 2.397s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" released by "delete_snapshot" :: held 2.421s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Created reservations ['12917ccc-d2f5-4fa9-8e9b-eb2d4fcf9580', 'e6f5d5d6-3ba0-4978-99f6-092af8c85b0a', 'ca099687-9547-495e-83fb-3dcc7437042e', '3e52e738-3b3b-4d06-b2cf-8b74cc333a4d'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:14:38 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Delete snapshot completed successfully.
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a8192701-05e1-48b6-9109-c5fda1ef5a0f tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-24c5a8b5-01a1-40b7-9e77-47a16a5f64aa-delete_snapshot" released by "delete_snapshot" :: held 2.984s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-a7706b84-7071-4a5c-9d64-39deacdc44f0-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-a7706b84-7071-4a5c-9d64-39deacdc44f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:38 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-quobyte-a7706b84-7071-4a5c-9d64-39deacdc44f0" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-a7706b84-7071-4a5c-9d64-39deacdc44f0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Deleting offline snapshot a7706b84-7071-4a5c-9d64-39deacdc44f0 of volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:14:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] snapshot_file for this snap is: volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:14:39 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa3205-9e5c-45f4-b4fd-b959dcf1bc56]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.710s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:14:39 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8770911-6615-4b7b-9846-0890e6e6a1df]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:40 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD" returned: 0 in 3.170s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2054319617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7690a1-98ae-4312-aa6f-a43624fa2c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d175bcba654467f84204a2c4f668710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:14:31Z,use_quota=True,user_id='118e1a876b994bdf9ed339dd9d7dafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Creating volume 8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:14:40 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:40 devstack quobyte-client[82407]: System call of process 91142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.864s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:14:40 devstack quobyte-client[82407]: System call of process 91144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:40 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=70, name=volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:14:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:40 devstack quobyte-client[82407]: System call of process 91149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a 1073741824" returned: 0 in 0.456s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.496s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 0 in 0.192s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] <== create_volume: return (826ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.a7706b84-7071-4a5c-9d64-39deacdc44f0" returned: 0 in 0.346s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-a7706b84-7071-4a5c-9d64-39deacdc44f0" released by "_delete_snapshot" :: held 2.779s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" released by "delete_snapshot" :: held 2.821s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:41 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Attempting download of 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume 8c7690a1-98ae-4312-aa6f-a43624fa2c1a. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 03 08:14:42 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc2d33-5fa4-46db-93d5-8805ff93800c]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_waqq0u6h {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:42 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Created reservations ['0a46655e-dbf1-4764-a9a7-a3780e9f8424', 'bc873e6d-0374-4523-b946-90919d6baae2', 'a4f11b62-9bd9-40be-9c1d-39a71cc7921a', '3bea6344-ebca-485b-9e7c-23071f304371'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:14:42 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Delete snapshot completed successfully.
Sep 03 08:14:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-247a1ec6-73bf-4b01-99e2-f48fbf5ccf7d tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-a7706b84-7071-4a5c-9d64-39deacdc44f0-delete_snapshot" released by "delete_snapshot" :: held 3.624s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_waqq0u6h" returned: 0 in 0.622s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_waqq0u6h {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_waqq0u6h" returned: 1 in 0.386s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_870a0d94-8d05-4c7b-aab1-1837efb2cb22_waqq0u6h' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbc25bf-eb29-4383-ac1c-e5cbc12b87bc]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-aafd967d-30e1-473b-b361-6b522f993856-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-aafd967d-30e1-473b-b361-6b522f993856-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:43 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-quobyte-aafd967d-30e1-473b-b361-6b522f993856" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-aafd967d-30e1-473b-b361-6b522f993856" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Deleting offline snapshot aafd967d-30e1-473b-b361-6b522f993856 of volume 27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] snapshot_file for this snap is: volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7db0b4-5591-4d8f-b305-35b343f0b450]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD" returned: 0 in 0.714s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] 870a0d94-8d05-4c7b-aab1-1837efb2cb22 was qcow2, converting to raw {{(pid=82397) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 03 08:14:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:44 devstack quobyte-client[82407]: System call of process 91177 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:44 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=70, name=volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:14:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.653s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:14:44 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[976acc67-f66f-4459-b29a-c96dbb57b9b6]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 0 in 1.262s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_870a0d94-8d05-4c7b-aab1-1837efb2cb22_z24n31j8devstack@QuobyteHD, size 112.00 MB, duration 1.31 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:14:45 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Converted 112.00 MB image at 85.69 MB/s
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:45 devstack quobyte-client[82407]: System call of process 91186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" returned: 0 in 0.868s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a 1G" returned: 0 in 0.318s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[508eedbc-16bc-48e8-8c29-123a1dd205b6]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.363s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b.aafd967d-30e1-473b-b361-6b522f993856" returned: 0 in 0.171s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-aafd967d-30e1-473b-b361-6b522f993856" released by "_delete_snapshot" :: held 2.556s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" released by "delete_snapshot" :: held 2.592s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 0 in 0.761s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:46 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Created reservations ['672c75af-7e01-4666-999e-f90cc1d9da83', 'd928ff09-2c01-42d3-8c1e-dc27ae423519', '99b35843-6272-4a56-9864-85369479b109', 'c4c7f7c6-4d54-4fdf-93c8-8a3fbe5c7ead'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 1 in 0.555s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Downloaded image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 ((None, None)) to volume 8c7690a1-98ae-4312-aa6f-a43624fa2c1a successfully. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Temporary image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 for user 118e1a876b994bdf9ed339dd9d7dafcc is deleted. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Marking volume 8c7690a1-98ae-4312-aa6f-a43624fa2c1a as bootable. {{(pid=82397) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Copying metadata from image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 to 8c7690a1-98ae-4312-aa6f-a43624fa2c1a. {{(pid=82397) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Creating volume glance metadata for volume 8c7690a1-98ae-4312-aa6f-a43624fa2c1a backed by image 870a0d94-8d05-4c7b-aab1-1837efb2cb22 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82397) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 03 08:14:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Delete snapshot completed successfully.
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-28b153b1-2955-464b-b43d-df44ea8cf08a tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-aafd967d-30e1-473b-b361-6b522f993856-delete_snapshot" released by "delete_snapshot" :: held 3.597s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b5d204-4c3c-449a-abb3-8c7c0e1e3325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a', 'volume_size': 1, 'image_id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36080e5de43f44e5b95945e87edd8915', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '870a0d94-8d05-4c7b-aab1-1837efb2cb22', 'created_at': datetime.datetime(2025, 9, 3, 5, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 5, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/870a0d94-8d05-4c7b-aab1-1837efb2cb22/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5ed16260>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447c066c-473b-4746-a718-2017dc1c8539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:47 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Volume volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a (8c7690a1-98ae-4312-aa6f-a43624fa2c1a): created successfully
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447c066c-473b-4746-a718-2017dc1c8539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Flow 'volume_create_manager' (28dc339e-aa82-4fd0-ab36-d416ab58a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:14:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5d6e7b87-9a7e-4d9a-a0d1-0d18c79d0dbc tempest-TestShelveInstance-118422212 None] Created volume successfully.
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-27f26750-c1c7-4341-b82a-0a6ebfe06d2b-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-27f26750-c1c7-4341-b82a-0a6ebfe06d2b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.405s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:14:48 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" acquired by "delete_volume" :: waited 0.076s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[2891818e-74d8-4d30-b3e5-1b8f9c39a1a8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" returned: 0 in 0.603s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" returned: 0 in 0.182s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-quobyte-27f26750-c1c7-4341-b82a-0a6ebfe06d2b" released by "delete_volume" :: held 1.021s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Created reservations ['9f14d298-2e0d-4174-9b9b-53045a156d51', '1b462b96-0545-489e-b8b8-f6146ee5ec99', '060bf440-0fbe-4946-a9ac-9762f436506e', '9d92fff8-87ad-4f60-bbf1-77ca00a85752'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.146s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:50 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:14:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Deleted volume successfully.
Sep 03 08:14:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b9d2fc9b-3a0a-4e70-a71c-29d78ff9b415 tempest-VolumesSnapshotListTestJSON-623719359 None] Lock "cinder-27f26750-c1c7-4341-b82a-0a6ebfe06d2b-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:14:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:55 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:14:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Flow 'volume_create_manager' (4c7dd11e-cbc3-4d83-8c26-0f93cce25912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:14:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1798243d-6186-4332-b9d6-6d4f025a5050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1798243d-6186-4332-b9d6-6d4f025a5050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-63680250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b77d98b-e473-4c06-a386-b0e2ccab55ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9f06c39a4e48448f64022402581924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:14:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:14:56Z,use_quota=True,user_id='9b408ed80de5435b8b33d58c242d9e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f84ddd4-02d9-4d28-916d-ee11d61db7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f84ddd4-02d9-4d28-916d-ee11d61db7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3da99e6-b376-4639-b260-bac3c1b03ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3da99e6-b376-4639-b260-bac3c1b03ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b77d98b-e473-4c06-a386-b0e2ccab55ff', 'volume_name': 'volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff', 'volume_size': 2}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9db1d35-5ead-4340-b630-d8c8979a8d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9db1d35-5ead-4340-b630-d8c8979a8d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159158bf-b9c0-416a-9faf-e206cce75ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:56 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Volume 5b77d98b-e473-4c06-a386-b0e2ccab55ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff', 'volume_size': 2}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-63680250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b77d98b-e473-4c06-a386-b0e2ccab55ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9f06c39a4e48448f64022402581924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:14:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:14:56Z,use_quota=True,user_id='9b408ed80de5435b8b33d58c242d9e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Creating volume 5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:14:56 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff 2147483648 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:56 devstack quobyte-client[82407]: System call of process 91214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:14:56 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=71, name=volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff 2147483648" returned: 0 in 0.579s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff" returned: 0 in 0.118s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:14:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:14:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159158bf-b9c0-416a-9faf-e206cce75ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff', 'volume_size': 2}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1880a277-41a7-4149-b615-73ef63432634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:14:57 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Volume volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff (5b77d98b-e473-4c06-a386-b0e2ccab55ff): created successfully
Sep 03 08:14:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1880a277-41a7-4149-b615-73ef63432634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:14:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Flow 'volume_create_manager' (4c7dd11e-cbc3-4d83-8c26-0f93cce25912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:14:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-39028efa-c089-42a3-9904-3f3c7907f670 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Created volume successfully.
Sep 03 08:14:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:14:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30d32db-8c37-423a-a20b-60e1eaff37b5]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:14:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:58 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:14:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:14:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 0 in 0.757s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:14:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 1 in 0.540s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:14:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:14:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.434s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.187s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Creating offline snapshot 02748851-dadd-4fcf-bf14-1fdba1104877 of volume 5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:15:00 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[009661e1-4988-43e2-aa9f-b1d156da7e91]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:00 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58b4b84a-cf3d-4c3a-bbc8-1d37dbbf2728', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:15:00 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:00 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-7aa18a47-2eb0-4292-b394-6201c0efa77d req-256ff62b-c683-4337-9db6-73a9ceaaab89 tempest-TestShelveInstance-118422212 None] attachment_update completed successfully.
Sep 03 08:15:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff" returned: 0 in 0.712s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 2G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:01 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=72, name=volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 2G" returned: 0 in 0.360s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:01 devstack quobyte-client[82407]: System call of process 91246 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "qemu-img rebase -u -b volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877" returned: 0 in 0.234s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877" returned: 0 in 0.163s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:15:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877" returned: 0 in 0.171s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.info" returned: 0 in 0.120s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:15:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.info" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:02 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4c399d0d-40de-4a4d-bcf8-4015785f9b49 tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Create snapshot completed successfully
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "cinder-02748851-dadd-4fcf-bf14-1fdba1104877-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-02748851-dadd-4fcf-bf14-1fdba1104877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:03 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "cinder-quobyte-5b77d98b-e473-4c06-a386-b0e2ccab55ff" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-quobyte-5b77d98b-e473-4c06-a386-b0e2ccab55ff" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "cinder-quobyte-02748851-dadd-4fcf-bf14-1fdba1104877" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-quobyte-02748851-dadd-4fcf-bf14-1fdba1104877" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Deleting offline snapshot 02748851-dadd-4fcf-bf14-1fdba1104877 of volume 5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] snapshot_file for this snap is: volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9232e926-c2f5-4e36-8785-b1e7da84b214]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877" returned: 0 in 0.455s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[db071653-bd51-4ee9-9603-30580d7a4af9]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff" returned: 0 in 0.442s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877" returned: 0 in 0.219s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff.02748851-dadd-4fcf-bf14-1fdba1104877" returned: 0 in 0.108s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-quobyte-02748851-dadd-4fcf-bf14-1fdba1104877" released by "_delete_snapshot" :: held 1.553s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-quobyte-5b77d98b-e473-4c06-a386-b0e2ccab55ff" released by "delete_snapshot" :: held 1.581s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:05 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Created reservations ['9ed712a1-4633-44f9-9c91-e71943fabc4f', '17fa7570-8b12-41c0-a803-da287f5443ce', '760f207f-2905-4284-858e-4727e0576431', '0df5f06a-5be0-4aa6-8e2c-d44dc9fd026d'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Delete snapshot completed successfully.
Sep 03 08:15:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d9c269a7-9b83-494c-a57c-1e75cd73ab4e tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-02748851-dadd-4fcf-bf14-1fdba1104877-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "cinder-5b77d98b-e473-4c06-a386-b0e2ccab55ff-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-5b77d98b-e473-4c06-a386-b0e2ccab55ff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:06 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "cinder-quobyte-5b77d98b-e473-4c06-a386-b0e2ccab55ff" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-quobyte-5b77d98b-e473-4c06-a386-b0e2ccab55ff" acquired by "delete_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6543e55-82c8-40d2-9e70-8928afb22a65]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff" returned: 0 in 0.445s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5b77d98b-e473-4c06-a386-b0e2ccab55ff" returned: 0 in 0.131s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-quobyte-5b77d98b-e473-4c06-a386-b0e2ccab55ff" released by "delete_volume" :: held 0.807s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Created reservations ['7378b915-3037-4f71-b059-8323b170a81d', '1459c6bf-8679-42b4-8841-b27bb2ce1696', 'ea3b615f-3aa7-4cad-bc19-d3ff96cde894', 'c7b65e83-53cf-42c1-ba30-5502f3594d3b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.107s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:08 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:08 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Deleted volume successfully.
Sep 03 08:15:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38c84713-709f-464d-a1e7-baa8d7eaf4cb tempest-VolumesSnapshotNegativeTestJSON-1495624002 None] Lock "cinder-5b77d98b-e473-4c06-a386-b0e2ccab55ff-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:15 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=57,cinder:SELECT=58,cinder:INSERT=26,cinder:DELETE=7 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=54,cinder:UPDATE=63,cinder:DELETE=3,cinder:INSERT=15 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:15:16 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (b906ee7c-69ee-439d-9b24-5dc19497c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19ee0cf-4a9f-48e4-b292-e78a54335052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19ee0cf-4a9f-48e4-b292-e78a54335052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-859015072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ee8245-9a0a-426a-b1a2-05ebcb78dab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:16Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ecbd52-570c-4a1e-8cde-5b3043437657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ecbd52-570c-4a1e-8cde-5b3043437657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e8d841-e046-4fcd-91a9-0defeac184cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e8d841-e046-4fcd-91a9-0defeac184cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ee8245-9a0a-426a-b1a2-05ebcb78dab2', 'volume_name': 'volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe010d6-d1cf-4de7-befd-b462d929a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe010d6-d1cf-4de7-befd-b462d929a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b709a7-2f9e-45c0-8eb4-4c2a670bebfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:16 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume 70ee8245-9a0a-426a-b1a2-05ebcb78dab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2', 'volume_size': 1}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-859015072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ee8245-9a0a-426a-b1a2-05ebcb78dab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:16Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Creating volume 70ee8245-9a0a-426a-b1a2-05ebcb78dab2 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:15:16 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:15:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:16 devstack quobyte-client[82407]: System call of process 91358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:16 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=74, name=volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2 1073741824" returned: 0 in 0.548s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2" returned: 0 in 0.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] <== create_volume: return (780ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b709a7-2f9e-45c0-8eb4-4c2a670bebfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be09f9f7-9c04-48eb-a034-a5153c02969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:17 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2 (70ee8245-9a0a-426a-b1a2-05ebcb78dab2): created successfully
Sep 03 08:15:17 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be09f9f7-9c04-48eb-a034-a5153c02969b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:18 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (b906ee7c-69ee-439d-9b24-5dc19497c278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:18 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5eefa307-d2c2-449f-8893-4d0daa76eafa tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created volume successfully.
Sep 03 08:15:19 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:19 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (20be2305-12bc-4f32-bc5e-fbe507173cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ed3283-b561-4c23-bab3-1f6dfbd5a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ed3283-b561-4c23-bab3-1f6dfbd5a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1824502290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:20Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0770a41-99ee-42eb-baa7-50183d6235ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0770a41-99ee-42eb-baa7-50183d6235ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef22085-7677-4982-827e-c3175b83dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef22085-7677-4982-827e-c3175b83dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c', 'volume_name': 'volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21fc0ed-f40e-453e-8a1b-c0fb5502f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21fc0ed-f40e-453e-8a1b-c0fb5502f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a72991e-941a-4fb2-9573-c6ef9bcfd343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:20 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c', 'volume_size': 1}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1824502290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:20Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Creating volume a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:15:20 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:15:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:20 devstack quobyte-client[82407]: System call of process 91364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:20 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=75, name=volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:15:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:15:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (a2824564-bff9-4995-96fb-a233f31ba85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c031d6-83bc-4afa-a032-711174a68fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c 1073741824" returned: 0 in 2.973s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-0585b944-75ac-4f4a-ac8e-178ad40d96d5 req-5d518248-6b4f-4d99-8b2f-4c084bf764b4 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:23 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (3914e956-8818-4eb5-85ad-08d52562469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf58e3d-6121-47a0-a6d7-0b9b0d7bc5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c031d6-83bc-4afa-a032-711174a68fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212176807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba881c-a45e-45b8-9754-e0f5bc30b0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:21Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343c3d35-1750-4af7-82bf-0b9846943cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343c3d35-1750-4af7-82bf-0b9846943cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dc9beb-511c-483a-a8a5-cfd78c9d37a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dc9beb-511c-483a-a8a5-cfd78c9d37a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbba881c-a45e-45b8-9754-e0f5bc30b0b6', 'volume_name': 'volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f853fc-c06e-4799-8a96-d4ac1298edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f853fc-c06e-4799-8a96-d4ac1298edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b98ad17-f013-4e94-bb93-3ea16878c4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume cbba881c-a45e-45b8-9754-e0f5bc30b0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6', 'volume_size': 1}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf58e3d-6121-47a0-a6d7-0b9b0d7bc5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-921199003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283368f3-5327-44d5-8c31-3ac317ba0c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:22Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131c108b-e646-489b-8e3b-6c57ee335bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131c108b-e646-489b-8e3b-6c57ee335bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6957ff56-3b6d-43ea-8ac4-5a4351c5358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6957ff56-3b6d-43ea-8ac4-5a4351c5358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283368f3-5327-44d5-8c31-3ac317ba0c83', 'volume_name': 'volume-283368f3-5327-44d5-8c31-3ac317ba0c83', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08aecdc6-385b-4d21-b7bd-dbf038a8a310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08aecdc6-385b-4d21-b7bd-dbf038a8a310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af011ad2-738b-4824-8bdc-8ed4bccbc304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume 283368f3-5327-44d5-8c31-3ac317ba0c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283368f3-5327-44d5-8c31-3ac317ba0c83', 'volume_size': 1}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c" returned: 0 in 1.403s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] <== create_volume: return (4521ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.538s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212176807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba881c-a45e-45b8-9754-e0f5bc30b0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:21Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Creating volume cbba881c-a45e-45b8-9754-e0f5bc30b0b6 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:15:24 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:15:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-0585b944-75ac-4f4a-ac8e-178ad40d96d5 req-5d518248-6b4f-4d99-8b2f-4c084bf764b4 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-0585b944-75ac-4f4a-ac8e-178ad40d96d5 req-5d518248-6b4f-4d99-8b2f-4c084bf764b4 tempest-AttachVolumeTestJSON-1596917585 None] Terminate volume connection completed successfully.
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-0585b944-75ac-4f4a-ac8e-178ad40d96d5 req-5d518248-6b4f-4d99-8b2f-4c084bf764b4 tempest-AttachVolumeTestJSON-1596917585 None] Deleting attachment f91ea51a-f0ae-4afd-b78f-0001ceac7a1e. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:15:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=76, name=volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:15:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (0afc493c-4a85-4a13-bf98-b81015e31b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3e576d-46c5-48df-b171-c7f580b9b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (137bdd3b-1c2c-4b90-a0c6-15562d9bc525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f863380e-2e62-446c-b60d-89b8fa58ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a72991e-941a-4fb2-9573-c6ef9bcfd343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ece0e25-151f-44d0-9ace-3711623787b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6 1073741824" returned: 0 in 1.072s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f863380e-2e62-446c-b60d-89b8fa58ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893335175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94aafe36-f216-46c5-81e6-6244a6242d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:23Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2dc618-0a9d-45ea-af25-2e29a7d3f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2dc618-0a9d-45ea-af25-2e29a7d3f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1367df5b-c9de-4dc7-8bff-710dce028a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1367df5b-c9de-4dc7-8bff-710dce028a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94aafe36-f216-46c5-81e6-6244a6242d58', 'volume_name': 'volume-94aafe36-f216-46c5-81e6-6244a6242d58', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc04cff7-e445-4649-9c2e-b22844246d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc04cff7-e445-4649-9c2e-b22844246d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c874237-47d5-44c2-941f-a2dcb65febc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume 94aafe36-f216-46c5-81e6-6244a6242d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94aafe36-f216-46c5-81e6-6244a6242d58', 'volume_size': 1}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3e576d-46c5-48df-b171-c7f580b9b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520500023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee833a-6b9b-4d15-8970-f512ce88ea5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:24Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875e81ee-24f6-402d-97c2-c30b164acb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875e81ee-24f6-402d-97c2-c30b164acb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa275fa-a402-42a4-9a81-eb26891b57cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa275fa-a402-42a4-9a81-eb26891b57cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beee833a-6b9b-4d15-8970-f512ce88ea5e', 'volume_name': 'volume-beee833a-6b9b-4d15-8970-f512ce88ea5e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38942fff-cd05-454f-bda1-9ef3af92227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38942fff-cd05-454f-bda1-9ef3af92227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b048922-eb66-4987-a87c-711ae3752f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume beee833a-6b9b-4d15-8970-f512ce88ea5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beee833a-6b9b-4d15-8970-f512ce88ea5e', 'volume_size': 1}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c (a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c): created successfully
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ece0e25-151f-44d0-9ace-3711623787b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (20be2305-12bc-4f32-bc5e-fbe507173cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6" returned: 0 in 0.893s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] <== create_volume: return (1990ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.062s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-921199003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283368f3-5327-44d5-8c31-3ac317ba0c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:22Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Creating volume 283368f3-5327-44d5-8c31-3ac317ba0c83 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:15:26 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:15:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:27 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=77, name=volume-283368f3-5327-44d5-8c31-3ac317ba0c83, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:15:27 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-71053cd0-cb5b-478a-a083-e2c4cb918083 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created volume successfully.
Sep 03 08:15:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83 1073741824" returned: 0 in 0.814s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b98ad17-f013-4e94-bb93-3ea16878c4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63704050-6ac1-4738-8c8c-829237583b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83" returned: 0 in 0.549s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] <== create_volume: return (1400ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893335175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94aafe36-f216-46c5-81e6-6244a6242d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:23Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Creating volume 94aafe36-f216-46c5-81e6-6244a6242d58 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:15:28 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:28 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6 (cbba881c-a45e-45b8-9754-e0f5bc30b0b6): created successfully
Sep 03 08:15:28 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=78, name=volume-94aafe36-f216-46c5-81e6-6244a6242d58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63704050-6ac1-4738-8c8c-829237583b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (a2824564-bff9-4995-96fb-a233f31ba85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af011ad2-738b-4824-8bdc-8ed4bccbc304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283368f3-5327-44d5-8c31-3ac317ba0c83', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d612946-622b-4fa3-aaff-42691c2a7833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-fba602b6-a212-44f5-bad3-29921a2c48fd tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created volume successfully.
Sep 03 08:15:29 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume volume-283368f3-5327-44d5-8c31-3ac317ba0c83 (283368f3-5327-44d5-8c31-3ac317ba0c83): created successfully
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d612946-622b-4fa3-aaff-42691c2a7833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (3914e956-8818-4eb5-85ad-08d52562469c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d5f99bed-36d8-48b6-84ea-bf729a4589db tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created volume successfully.
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58 1073741824" returned: 0 in 0.968s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58" returned: 0 in 0.313s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] <== create_volume: return (1636ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:15:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.830s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520500023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee833a-6b9b-4d15-8970-f512ce88ea5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fed6c21d0444b09f82e3f3bd93506c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:15:24Z,use_quota=True,user_id='9341271e540049dfab1040b145aff73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Creating volume beee833a-6b9b-4d15-8970-f512ce88ea5e {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:15:30 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:15:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:30 devstack quobyte-client[82407]: System call of process 91425 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:31 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=79, name=volume-beee833a-6b9b-4d15-8970-f512ce88ea5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:15:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c874237-47d5-44c2-941f-a2dcb65febc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94aafe36-f216-46c5-81e6-6244a6242d58', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d0ae6d-ea99-45f5-a05a-d77ad36c3b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume volume-94aafe36-f216-46c5-81e6-6244a6242d58 (94aafe36-f216-46c5-81e6-6244a6242d58): created successfully
Sep 03 08:15:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d0ae6d-ea99-45f5-a05a-d77ad36c3b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (137bdd3b-1c2c-4b90-a0c6-15562d9bc525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e 1073741824" returned: 0 in 0.917s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ef1d5ec1-80bb-4fbf-a7cd-cd1a2faddf1a tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created volume successfully.
Sep 03 08:15:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e" returned: 0 in 0.477s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] <== create_volume: return (1550ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:15:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b048922-eb66-4987-a87c-711ae3752f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beee833a-6b9b-4d15-8970-f512ce88ea5e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50949275-f3bf-48cf-ac63-cfb780942e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:15:32 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume volume-beee833a-6b9b-4d15-8970-f512ce88ea5e (beee833a-6b9b-4d15-8970-f512ce88ea5e): created successfully
Sep 03 08:15:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50949275-f3bf-48cf-ac63-cfb780942e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:15:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Flow 'volume_create_manager' (0afc493c-4a85-4a13-bf98-b81015e31b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:15:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cc9aab55-d35e-447b-8e66-d9edb8d59598 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created volume successfully.
Sep 03 08:15:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-beee833a-6b9b-4d15-8970-f512ce88ea5e-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-beee833a-6b9b-4d15-8970-f512ce88ea5e-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-quobyte-beee833a-6b9b-4d15-8970-f512ce88ea5e" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-beee833a-6b9b-4d15-8970-f512ce88ea5e" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[4238e9b5-3dda-4b91-97b2-2dece70a37a9]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:34 devstack quobyte-client[82407]: System call of process 91431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e" returned: 0 in 0.565s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-beee833a-6b9b-4d15-8970-f512ce88ea5e" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-beee833a-6b9b-4d15-8970-f512ce88ea5e" released by "delete_volume" :: held 0.891s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created reservations ['13d9a57c-f93d-488e-8646-06c7cd07d1ef', '7bfaed77-af20-4c76-8f0e-16037f2250ca', '7b1cedf7-0a90-47b9-882a-1b80c5fc7a19', '84afa264-e05a-41cd-a914-85735c47dd89'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.312s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:35 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-94aafe36-f216-46c5-81e6-6244a6242d58-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Deleted volume successfully.
Sep 03 08:15:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-94aafe36-f216-46c5-81e6-6244a6242d58-delete_volume" acquired by "delete_volume" :: waited 0.903s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a9f1b321-fcaa-4d52-989e-63713ccee09b tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-beee833a-6b9b-4d15-8970-f512ce88ea5e-delete_volume" released by "delete_volume" :: held 3.986s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:38 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-quobyte-94aafe36-f216-46c5-81e6-6244a6242d58" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-94aafe36-f216-46c5-81e6-6244a6242d58" acquired by "delete_volume" :: waited 0.026s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:38 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb00488-dd4d-4aa2-a43e-a4b69068e3ee]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:39 devstack quobyte-client[82407]: System call of process 91468 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58" returned: 0 in 1.182s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-94aafe36-f216-46c5-81e6-6244a6242d58" returned: 0 in 0.186s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-94aafe36-f216-46c5-81e6-6244a6242d58" released by "delete_volume" :: held 1.688s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:40 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created reservations ['4f94a47d-1d91-434c-95cf-ce83849b68ca', 'fae0eb16-c2db-4ffd-82a1-8b8d09284009', 'fc12e495-d8b2-44b7-8d01-9c675fc31c1d', '4265cdd7-4b21-465c-93ae-c5e7796c6de7'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.255s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:41 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:41 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Deleted volume successfully.
Sep 03 08:15:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-283368f3-5327-44d5-8c31-3ac317ba0c83-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-defccb5f-66e1-4f0d-bc50-9ce257fe5d4f tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-94aafe36-f216-46c5-81e6-6244a6242d58-delete_volume" released by "delete_volume" :: held 4.616s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-283368f3-5327-44d5-8c31-3ac317ba0c83-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:42 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-quobyte-283368f3-5327-44d5-8c31-3ac317ba0c83" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-283368f3-5327-44d5-8c31-3ac317ba0c83" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:42 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da311cd-c1a8-4306-94b5-ac84c4269c81]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83" returned: 0 in 0.798s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-283368f3-5327-44d5-8c31-3ac317ba0c83" returned: 0 in 0.340s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-283368f3-5327-44d5-8c31-3ac317ba0c83" released by "delete_volume" :: held 1.384s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:44 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created reservations ['cfed53b3-7995-4c86-92a5-e60464857528', '4999245d-1411-4ac4-8175-ec30d9f24b52', 'aa1cf617-1471-4c44-91a7-0ba63d7e46af', '3022cf68-1e69-401b-ab48-9793a04b945f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.141s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Deleted volume successfully.
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e716b233-dc82-4544-87b1-bfd002be938e tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-283368f3-5327-44d5-8c31-3ac317ba0c83-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-cbba881c-a45e-45b8-9754-e0f5bc30b0b6-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-cbba881c-a45e-45b8-9754-e0f5bc30b0b6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-quobyte-cbba881c-a45e-45b8-9754-e0f5bc30b0b6" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-cbba881c-a45e-45b8-9754-e0f5bc30b0b6" acquired by "delete_volume" :: waited 0.031s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[7728c6fb-9e9b-4561-8037-e69e9a02c43e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6" returned: 0 in 0.818s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cbba881c-a45e-45b8-9754-e0f5bc30b0b6" returned: 0 in 0.187s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-cbba881c-a45e-45b8-9754-e0f5bc30b0b6" released by "delete_volume" :: held 1.291s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created reservations ['5dc4bb1a-ab63-43ef-bb52-8406592e6959', '67bf8c1b-8a8e-411d-8ef7-23fcf13a4111', '9d9f5af8-9d61-48a4-a05b-044b5da357a9', '582deddb-0fdf-40d8-a2a0-60688078e1b2'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.277s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:47 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Deleted volume successfully.
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6b22a7c5-e27a-4246-a02d-428a83ec2e99 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-cbba881c-a45e-45b8-9754-e0f5bc30b0b6-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c-delete_volume" acquired by "delete_volume" :: waited 0.356s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.712s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:49 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-quobyte-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:49 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[227686db-a61b-4b6e-be8b-0afb0ee455ee]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:50 devstack quobyte-client[82407]: System call of process 91526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c" returned: 0 in 1.650s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c" returned: 0 in 0.757s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c" released by "delete_volume" :: held 3.446s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:53 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created reservations ['c3689c05-3461-4a94-993c-a8b85338f53e', 'd042b294-83ff-46b4-aeec-5d0ac4a288ae', '2768dc4b-41a5-46f4-80ab-6ed30d399601', 'a3022cf8-f8bf-4c8b-80df-a472f772ff61'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.288s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:54 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:54 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Deleted volume successfully.
Sep 03 08:15:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-70ee8245-9a0a-426a-b1a2-05ebcb78dab2-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-70ee8245-9a0a-426a-b1a2-05ebcb78dab2-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-38b2cad2-b97b-4afb-af8a-0765d9e2b901 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-a39b8b45-ca2a-4d84-81b4-64ee4e1f8b7c-delete_volume" released by "delete_volume" :: held 6.219s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:15:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "cinder-quobyte-70ee8245-9a0a-426a-b1a2-05ebcb78dab2" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:15:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-70ee8245-9a0a-426a-b1a2-05ebcb78dab2" acquired by "delete_volume" :: waited 0.037s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:15:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af600ac-bb49-4e84-aec9-af49a4b89047]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:15:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:56 devstack quobyte-client[82407]: System call of process 91597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:15:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2" returned: 0 in 1.351s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70ee8245-9a0a-426a-b1a2-05ebcb78dab2" returned: 0 in 0.243s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-quobyte-70ee8245-9a0a-426a-b1a2-05ebcb78dab2" released by "delete_volume" :: held 2.010s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Created reservations ['fe78c30f-1c8b-442a-84da-41308ca9b552', '819763d8-320e-40f2-9b95-6660a719ccb7', '04e020f9-c8f6-4f15-9104-6f34dfa2a9ae', '207dcd06-90ca-415e-bb9d-f8bec2a2768e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:15:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:15:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.138s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:15:58 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:15:58 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Deleted volume successfully.
Sep 03 08:15:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f9a5dcc3-061e-4bb7-9d58-0a60c66b0230 tempest-CreateVolumesFromSourceVolumeTest-1538153408 None] Lock "cinder-70ee8245-9a0a-426a-b1a2-05ebcb78dab2-delete_volume" released by "delete_volume" :: held 3.621s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:16:07 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=36,cinder:UPDATE=56,cinder:DELETE=5,cinder:INSERT=14 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:16:08 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:DELETE=7,cinder:UPDATE=63,cinder:SELECT=37,cinder:INSERT=10 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:16:37 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-d575a012-da16-4852-ae5a-e872c8493653 req-1deb8192-e86b-40fb-966b-cf513c07645a tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:16:37 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-d575a012-da16-4852-ae5a-e872c8493653 req-1deb8192-e86b-40fb-966b-cf513c07645a tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:16:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-d575a012-da16-4852-ae5a-e872c8493653 req-1deb8192-e86b-40fb-966b-cf513c07645a tempest-TestShelveInstance-118422212 None] Terminate volume connection completed successfully.
Sep 03 08:16:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-d575a012-da16-4852-ae5a-e872c8493653 req-1deb8192-e86b-40fb-966b-cf513c07645a tempest-TestShelveInstance-118422212 None] Deleting attachment 58b4b84a-cf3d-4c3a-bbc8-1d37dbbf2728. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:16:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:16:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:16:44 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b24ad2f-81f7-49e6-b78e-5572de06a422]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:16:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:16:45 devstack quobyte-client[82407]: System call of process 91751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:16:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 0 in 0.445s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:16:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:16:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 1 in 0.502s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:16:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:16:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.188s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:16:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c391631-fbad-47de-bc8b-314b1c958dde', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:16:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:16:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-b6575000-b82c-4907-acfd-c94b0293ae0e req-60862eff-dfa7-4d30-8d89-9344a70d1544 tempest-TestShelveInstance-118422212 None] attachment_update completed successfully.
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.138s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:16:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:17:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:17:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.124s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:17:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:18:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-4e7bb3d8-a228-484a-a055-a0fa0ac92f33 tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-4e7bb3d8-a228-484a-a055-a0fa0ac92f33 tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:22 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-4e7bb3d8-a228-484a-a055-a0fa0ac92f33 tempest-TestShelveInstance-118422212 None] Terminate volume connection completed successfully.
Sep 03 08:18:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-4e7bb3d8-a228-484a-a055-a0fa0ac92f33 tempest-TestShelveInstance-118422212 None] Deleting attachment 0c391631-fbad-47de-bc8b-314b1c958dde. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:18:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Acquiring lock "cinder-8c7690a1-98ae-4312-aa6f-a43624fa2c1a-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Lock "cinder-8c7690a1-98ae-4312-aa6f-a43624fa2c1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Acquiring lock "cinder-quobyte-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Lock "cinder-quobyte-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" acquired by "delete_volume" :: waited 0.017s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:23 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[35651ee2-4062-424e-843a-9b9d12a0b9fa]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:18:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:24 devstack quobyte-client[82407]: System call of process 92590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:18:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 0 in 0.523s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:24 devstack quobyte-client[82407]: System call of process 92592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:18:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 1 in 0.432s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:18:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:24 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Lock "cinder-quobyte-8c7690a1-98ae-4312-aa6f-a43624fa2c1a" released by "delete_volume" :: held 1.358s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG cinder.quota [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Created reservations ['0fd5d709-a8df-449a-9f31-1b7797a87e35', 'ba519c52-f8bc-4c31-ab75-93659363177f', 'ebda1ed0-396b-448d-a8f1-e11a2841b159', '9cbcb355-749c-48b7-8ad4-fddaf25837fd'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.091s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG cinder.manager [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:18:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Deleted volume successfully.
Sep 03 08:18:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-cdc7bffd-cf52-45d4-8ca4-2cf6f114be7d req-207a914a-f4fe-4ee9-8164-66e2531eb0ca tempest-TestShelveInstance-118422212 None] Lock "cinder-8c7690a1-98ae-4312-aa6f-a43624fa2c1a-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:18:35 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:18:35 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:18:42 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (8051fe8f-6369-4b5d-a9fc-9319c84d0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9bd9bf-ace6-4733-91bd-8ea6d1161f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9bd9bf-ace6-4733-91bd-8ea6d1161f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963353723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:42Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e9af9f-cd8b-4c0c-9df1-a25bcd191fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e9af9f-cd8b-4c0c-9df1-a25bcd191fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85ee64d-4444-45b8-b50f-511821ccd34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85ee64d-4444-45b8-b50f-511821ccd34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea', 'volume_name': 'volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a20033-a184-4d96-9230-5cbd95014e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a20033-a184-4d96-9230-5cbd95014e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c0a13f-b900-40f7-8374-f8ff7669d7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:42 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea', 'volume_size': 1}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963353723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:42Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Creating volume be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:18:42 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:42 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=80, name=volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea 1073741824" returned: 0 in 0.354s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] <== create_volume: return (525ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:18:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.537s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c0a13f-b900-40f7-8374-f8ff7669d7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ffc767-1160-4fd4-bac1-2210f114caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:43 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea (be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea): created successfully
Sep 03 08:18:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ffc767-1160-4fd4-bac1-2210f114caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (8051fe8f-6369-4b5d-a9fc-9319c84d0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a69c1a70-92c3-49be-9526-182a46ef2714 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created volume successfully.
Sep 03 08:18:44 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Creating offline snapshot d8062b50-3e4b-4e02-96c9-2d147cdeb935 of volume be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:18:44 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8684bee-21a6-4693-a656-6c2dd07e7cc5]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:18:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" returned: 0 in 0.427s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:45 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=81, name=volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 1G" returned: 0 in 0.230s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img rebase -u -b volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img rebase -u -b volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935" returned: 0 in 0.166s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935" returned: 0 in 0.083s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935" returned: 0 in 0.103s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.info" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:18:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.info" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.483s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7a6941e2-c8e7-4dc4-870a-c624250ea974 tempest-CreateVolumesFromSnapshotTest-243405246 None] Create snapshot completed successfully
Sep 03 08:18:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (37cce03d-f30a-4a2e-aa51-214221508138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea026d60-7870-4e60-b8c5-38c0ad47e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea026d60-7870-4e60-b8c5-38c0ad47e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-778020548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cfd77b-2c8c-4696-b3f9-d6195c27be3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:47Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571ae688-c4fc-487f-b423-481bbdc2441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571ae688-c4fc-487f-b423-481bbdc2441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74adbf1-1626-43af-9184-640b681f766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74adbf1-1626-43af-9184-640b681f766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cfd77b-2c8c-4696-b3f9-d6195c27be3f', 'volume_name': 'volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c7eaf0-67e4-4864-bfd7-29800cd41340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c7eaf0-67e4-4864-bfd7-29800cd41340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6070bf5d-1087-480f-be16-8b6267ae97f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:47 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume 77cfd77b-2c8c-4696-b3f9-d6195c27be3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f', 'volume_size': 1}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-778020548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cfd77b-2c8c-4696-b3f9-d6195c27be3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:47Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Creating volume 77cfd77b-2c8c-4696-b3f9-d6195c27be3f {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:18:47 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:18:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:47 devstack quobyte-client[82407]: System call of process 92674 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:18:47 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=83, name=volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f 1073741824" returned: 0 in 0.726s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:48 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (ea43a4b2-5e3b-46c3-b124-6b4a1f16f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1ca2e6-d969-495d-91f6-f75e9d492aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f" returned: 0 in 1.140s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1ca2e6-d969-495d-91f6-f75e9d492aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1646524272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b165089-6f01-49ba-9f0e-38481dcfb320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:48Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a5eabc-c495-4fa5-a6a6-3696929d44e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a5eabc-c495-4fa5-a6a6-3696929d44e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6725db1-6ea8-406a-9c4a-64bb959c770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6725db1-6ea8-406a-9c4a-64bb959c770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b165089-6f01-49ba-9f0e-38481dcfb320', 'volume_name': 'volume-9b165089-6f01-49ba-9f0e-38481dcfb320', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2ab49e-f469-47c1-ab2d-fa519d08e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2ab49e-f469-47c1-ab2d-fa519d08e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a5a17e-21cf-45f7-8a39-983f6786988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:49 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume 9b165089-6f01-49ba-9f0e-38481dcfb320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b165089-6f01-49ba-9f0e-38481dcfb320', 'volume_size': 1}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] <== create_volume: return (2021ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1646524272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b165089-6f01-49ba-9f0e-38481dcfb320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:48Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Creating volume 9b165089-6f01-49ba-9f0e-38481dcfb320 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:18:49 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:49 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=84, name=volume-9b165089-6f01-49ba-9f0e-38481dcfb320, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6070bf5d-1087-480f-be16-8b6267ae97f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057af400-49df-45dd-a794-12eca4267f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 1.243s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:18:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (c5c80cf0-4b5e-46b2-93d0-0d2e6985eb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a75792-8a8b-42c1-8b2c-5761dcba36e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a75792-8a8b-42c1-8b2c-5761dcba36e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246245529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc829813-3286-405b-aae0-245152c6b9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:49Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899d921d-90ff-4567-9954-78ba4d78ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899d921d-90ff-4567-9954-78ba4d78ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83c1436-2606-40ce-8030-2b37690fc2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83c1436-2606-40ce-8030-2b37690fc2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc829813-3286-405b-aae0-245152c6b9d0', 'volume_name': 'volume-dc829813-3286-405b-aae0-245152c6b9d0', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb316d2-36f0-49a6-9900-02bb8ec7d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb316d2-36f0-49a6-9900-02bb8ec7d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c32ee22-5d01-4cce-90e7-b882d6be405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume dc829813-3286-405b-aae0-245152c6b9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc829813-3286-405b-aae0-245152c6b9d0', 'volume_size': 1}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (ddcba652-7c5d-4242-9bb7-06a0f6ca228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5509d10f-ea4f-47dc-9401-c25cf9460202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320 1073741824" returned: 0 in 0.786s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:50 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f (77cfd77b-2c8c-4696-b3f9-d6195c27be3f): created successfully
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057af400-49df-45dd-a794-12eca4267f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (37cce03d-f30a-4a2e-aa51-214221508138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-998206b3-16e7-4b10-89db-0a44869f1cf0 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created volume successfully.
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5509d10f-ea4f-47dc-9401-c25cf9460202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1399020938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df14673c-663d-4520-9695-e14e28e053c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:48Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9ad2d7-8bf6-4b49-a413-2e2410a0e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9ad2d7-8bf6-4b49-a413-2e2410a0e523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448bf711-364d-498c-bca4-261483fb1d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448bf711-364d-498c-bca4-261483fb1d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df14673c-663d-4520-9695-e14e28e053c0', 'volume_name': 'volume-df14673c-663d-4520-9695-e14e28e053c0', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3a1881-25dc-4340-bc08-0999467704ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3a1881-25dc-4340-bc08-0999467704ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f22f20-f5e7-4629-a96c-13beef2db86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume df14673c-663d-4520-9695-e14e28e053c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df14673c-663d-4520-9695-e14e28e053c0', 'volume_size': 1}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320" returned: 0 in 0.428s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (2451ea7b-d447-4c40-85f4-8d93f1f2a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04195cb-ad1c-456d-9bae-8fe4cc06953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] <== create_volume: return (1348ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246245529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc829813-3286-405b-aae0-245152c6b9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:49Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Creating volume dc829813-3286-405b-aae0-245152c6b9d0 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:18:50 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:18:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:51 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=85, name=volume-dc829813-3286-405b-aae0-245152c6b9d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a5a17e-21cf-45f7-8a39-983f6786988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b165089-6f01-49ba-9f0e-38481dcfb320', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ac0ed3-580a-4a85-ad57-445842211d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04195cb-ad1c-456d-9bae-8fe4cc06953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603935654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1087c3ff-ac4e-479c-94ea-c4da770e919b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:50Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f64b20-ed47-40c4-82a0-a7884bb46b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f64b20-ed47-40c4-82a0-a7884bb46b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa790c8c-45c9-46a6-8ea3-a72a3661c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa790c8c-45c9-46a6-8ea3-a72a3661c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1087c3ff-ac4e-479c-94ea-c4da770e919b', 'volume_name': 'volume-1087c3ff-ac4e-479c-94ea-c4da770e919b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7becbb41-2ba6-4789-ac2d-86b7f3bf9011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7becbb41-2ba6-4789-ac2d-86b7f3bf9011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ef1ae2-af3b-41a4-acda-f4a7333aae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:51 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume 1087c3ff-ac4e-479c-94ea-c4da770e919b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1087c3ff-ac4e-479c-94ea-c4da770e919b', 'volume_size': 1}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:51 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume volume-9b165089-6f01-49ba-9f0e-38481dcfb320 (9b165089-6f01-49ba-9f0e-38481dcfb320): created successfully
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ac0ed3-580a-4a85-ad57-445842211d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (ea43a4b2-5e3b-46c3-b124-6b4a1f16f11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0 1073741824" returned: 0 in 0.523s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:51 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8cbaba1b-5cb4-4e92-8f49-ddb4f42fdd5a tempest-CreateVolumesFromSnapshotTest-243405246 None] Created volume successfully.
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0" returned: 0 in 0.244s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1399020938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df14673c-663d-4520-9695-e14e28e053c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:48Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Creating volume df14673c-663d-4520-9695-e14e28e053c0 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:18:51 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:51 devstack quobyte-client[82407]: System call of process 92687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:18:51 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=86, name=volume-df14673c-663d-4520-9695-e14e28e053c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c32ee22-5d01-4cce-90e7-b882d6be405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc829813-3286-405b-aae0-245152c6b9d0', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bad11e9-b87b-4999-804b-19861d37efe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:52 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume volume-dc829813-3286-405b-aae0-245152c6b9d0 (dc829813-3286-405b-aae0-245152c6b9d0): created successfully
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bad11e9-b87b-4999-804b-19861d37efe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (c5c80cf0-4b5e-46b2-93d0-0d2e6985eb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-23707f79-2d3e-4bf9-a9fb-7b00bcd2ed16 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created volume successfully.
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0 1073741824" returned: 0 in 0.544s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0" returned: 0 in 0.147s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] <== create_volume: return (739ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.240s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603935654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1087c3ff-ac4e-479c-94ea-c4da770e919b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e318cd0c63416d943d58a7aad83b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:50Z,use_quota=True,user_id='f0e388d884d54902993e98912352f895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Creating volume 1087c3ff-ac4e-479c-94ea-c4da770e919b {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:18:52 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:52 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=87, name=volume-1087c3ff-ac4e-479c-94ea-c4da770e919b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f22f20-f5e7-4629-a96c-13beef2db86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df14673c-663d-4520-9695-e14e28e053c0', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ad3536-78bf-4ceb-a48e-bd6badfed2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:52 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume volume-df14673c-663d-4520-9695-e14e28e053c0 (df14673c-663d-4520-9695-e14e28e053c0): created successfully
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ad3536-78bf-4ceb-a48e-bd6badfed2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (ddcba652-7c5d-4242-9bb7-06a0f6ca228a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b 1073741824" returned: 0 in 0.456s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b" returned: 0 in 0.144s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] <== create_volume: return (663ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:18:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:53 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7c9d74a9-2506-481f-9d55-0fe1c213e439 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created volume successfully.
Sep 03 08:18:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ef1ae2-af3b-41a4-acda-f4a7333aae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1087c3ff-ac4e-479c-94ea-c4da770e919b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e0b40a-6187-40aa-a702-8d6d7e9ba1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:53 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume volume-1087c3ff-ac4e-479c-94ea-c4da770e919b (1087c3ff-ac4e-479c-94ea-c4da770e919b): created successfully
Sep 03 08:18:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e0b40a-6187-40aa-a702-8d6d7e9ba1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Flow 'volume_create_manager' (2451ea7b-d447-4c40-85f4-8d93f1f2a193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:53 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8252fea7-138d-4a0a-aa5a-e5f6879d5567 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created volume successfully.
Sep 03 08:18:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-1087c3ff-ac4e-479c-94ea-c4da770e919b-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-1087c3ff-ac4e-479c-94ea-c4da770e919b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-1087c3ff-ac4e-479c-94ea-c4da770e919b" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-1087c3ff-ac4e-479c-94ea-c4da770e919b" acquired by "delete_volume" :: waited 0.022s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:54 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c602cc-0062-45a9-9253-eab92fd01c01]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:18:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b" returned: 0 in 0.434s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1087c3ff-ac4e-479c-94ea-c4da770e919b" returned: 0 in 0.118s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-1087c3ff-ac4e-479c-94ea-c4da770e919b" released by "delete_volume" :: held 0.774s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:18:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:55 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:18:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Flow 'volume_create_manager' (9c25d057-7747-4d00-98aa-fedd49f26021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed28bc8-f91b-4efd-8a56-3bc5e6bf7d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed28bc8-f91b-4efd-8a56-3bc5e6bf7d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1230291874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b09775-9267-4c7f-b484-9e8522d29b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3071dbf2b91d45d594825d370a341d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:56Z,use_quota=True,user_id='c8f00ae1eb074b73bddc8dadff794e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c12e1ed-5b2a-47b9-842d-4208d72a4712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c12e1ed-5b2a-47b9-842d-4208d72a4712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ffb90f-aba5-470d-9fa4-74af7a2d538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ffb90f-aba5-470d-9fa4-74af7a2d538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b09775-9267-4c7f-b484-9e8522d29b42', 'volume_name': 'volume-d4b09775-9267-4c7f-b484-9e8522d29b42', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af7e247-fc56-48e9-bdcd-e36a9d15d427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af7e247-fc56-48e9-bdcd-e36a9d15d427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0590c7-be16-44a8-a8dc-8dd02b1de361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:56 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Volume d4b09775-9267-4c7f-b484-9e8522d29b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b09775-9267-4c7f-b484-9e8522d29b42', 'volume_size': 1}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1230291874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b09775-9267-4c7f-b484-9e8522d29b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3071dbf2b91d45d594825d370a341d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:18:56Z,use_quota=True,user_id='c8f00ae1eb074b73bddc8dadff794e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Creating volume d4b09775-9267-4c7f-b484-9e8522d29b42 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:18:56 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:56 devstack quobyte-client[82407]: System call of process 92704 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:18:56 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=88, name=volume-d4b09775-9267-4c7f-b484-9e8522d29b42, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Created reservations ['9f3ea3d4-7450-4000-ad3a-d441c7397a99', '04cac7a9-9895-42c1-a424-31d9bb61d340', 'f60ffd83-0111-48c6-83bf-161bba7cc8c1', '5351f3bd-8e1b-48f7-880f-d2096beffa2e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42 1073741824" returned: 0 in 0.423s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-dc829813-3286-405b-aae0-245152c6b9d0-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42" returned: 0 in 0.619s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] <== create_volume: return (1060ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.349s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-dc829813-3286-405b-aae0-245152c6b9d0-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0590c7-be16-44a8-a8dc-8dd02b1de361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b09775-9267-4c7f-b484-9e8522d29b42', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066c1f5-7906-470f-b747-513fdf7a8ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:18:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Deleted volume successfully.
Sep 03 08:18:57 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Volume volume-d4b09775-9267-4c7f-b484-9e8522d29b42 (d4b09775-9267-4c7f-b484-9e8522d29b42): created successfully
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066c1f5-7906-470f-b747-513fdf7a8ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Flow 'volume_create_manager' (9c25d057-7747-4d00-98aa-fedd49f26021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7422b7f8-cc50-4a24-912a-e904bf7a1f4c tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-1087c3ff-ac4e-479c-94ea-c4da770e919b-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:18:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a8d5a170-5f8e-4e4e-bfec-4a9fe55bc936 tempest-AttachVolumeTestJSON-1596917585 None] Created volume successfully.
Sep 03 08:18:57 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-dc829813-3286-405b-aae0-245152c6b9d0" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-dc829813-3286-405b-aae0-245152c6b9d0" acquired by "delete_volume" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a32de-b021-4328-9dae-f0ffa2fd9d88]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:18:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0" returned: 0 in 0.458s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-dc829813-3286-405b-aae0-245152c6b9d0" returned: 0 in 0.119s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-dc829813-3286-405b-aae0-245152c6b9d0" released by "delete_volume" :: held 0.705s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Created reservations ['a17e24bb-e5b3-498a-a275-6804bb1dffa3', '96d02fff-c78c-468c-b23c-3e9229d496f8', '89f9f287-61a7-401f-94b6-7672fda75660', '8720b565-2fd4-447f-b42b-771d34438d63'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:18:58 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Deleted volume successfully.
Sep 03 08:18:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-99dad18c-961e-4507-ae3f-8e99522aec2a tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-dc829813-3286-405b-aae0-245152c6b9d0-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-df14673c-663d-4520-9695-e14e28e053c0-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-df14673c-663d-4520-9695-e14e28e053c0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:59 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-df14673c-663d-4520-9695-e14e28e053c0" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-df14673c-663d-4520-9695-e14e28e053c0" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9720ee4b-442d-4410-a779-8e2188fd07f9]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0" returned: 0 in 0.398s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:18:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-df14673c-663d-4520-9695-e14e28e053c0" returned: 0 in 0.108s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-df14673c-663d-4520-9695-e14e28e053c0" released by "delete_volume" :: held 0.644s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created reservations ['0b100ffd-2a2b-40ef-9fe5-c65fe9bbdbd5', '2f569da2-9772-4f43-b5f3-f2a13a17ce5a', '55a47d8f-59f1-4488-aa27-63d606051db3', '0e140f19-6bb2-4a43-82a6-7869b67fa24d'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.102s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:00 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:19:00 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Deleted volume successfully.
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-518c9d10-c1d8-441a-b720-b7d0b3046935 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-df14673c-663d-4520-9695-e14e28e053c0-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-9b165089-6f01-49ba-9f0e-38481dcfb320-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-9b165089-6f01-49ba-9f0e-38481dcfb320-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3737f99a-0c23-4c89-af2f-8629a489f12a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:01 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-9b165089-6f01-49ba-9f0e-38481dcfb320" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-9b165089-6f01-49ba-9f0e-38481dcfb320" acquired by "delete_volume" :: waited 0.176s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd571b82-80b1-49ed-9660-84119f1f34ab]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42" returned: 0 in 0.516s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.609s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320" returned: 0 in 0.586s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-d4b09775-9267-4c7f-b484-9e8522d29b42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '395b3f96-1e0e-4d5b-82ab-f337302d4454', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:19:02 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9b165089-6f01-49ba-9f0e-38481dcfb320" returned: 0 in 0.246s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-9b165089-6f01-49ba-9f0e-38481dcfb320" released by "delete_volume" :: held 1.053s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:03 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-08a07606-8420-4951-9149-c03b5a1e4982 req-5eb5bfbe-3059-43c5-af3d-f3848dea0e2f tempest-AttachVolumeTestJSON-1596917585 None] attachment_update completed successfully.
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created reservations ['09264270-90ba-4982-8ed4-42e6a28a5c46', 'c34c1c69-f159-4c8b-ac85-28365e49c3bf', 'f9920eb7-080a-42f1-8994-a00efedaf375', 'b42432bb-8c50-4ec5-b474-1e1fe5f6fdf0'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:19:03 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Deleted volume successfully.
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4251d7bf-b0e2-4145-85ee-0d63b5a9c9e3 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-9b165089-6f01-49ba-9f0e-38481dcfb320-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-77cfd77b-2c8c-4696-b3f9-d6195c27be3f-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-77cfd77b-2c8c-4696-b3f9-d6195c27be3f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:04 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-77cfd77b-2c8c-4696-b3f9-d6195c27be3f" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-77cfd77b-2c8c-4696-b3f9-d6195c27be3f" acquired by "delete_volume" :: waited 0.042s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[29598f8e-1711-4a3a-9701-f6ea2bf982a3]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f" returned: 0 in 0.537s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-77cfd77b-2c8c-4696-b3f9-d6195c27be3f" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-77cfd77b-2c8c-4696-b3f9-d6195c27be3f" released by "delete_volume" :: held 0.787s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Created reservations ['7efc9365-c274-42a8-a3fa-9a5426dcb9e8', 'd692f485-392d-49f9-96ce-51c259598653', 'c04f978d-240a-40ae-b591-940bc620382b', '970318be-937f-4a97-baff-2a72da68ca38'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:19:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Deleted volume successfully.
Sep 03 08:19:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-006c5745-b6eb-48d1-831d-d6aa0f05cb06 tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-77cfd77b-2c8c-4696-b3f9-d6195c27be3f-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-d8062b50-3e4b-4e02-96c9-2d147cdeb935-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-d8062b50-3e4b-4e02-96c9-2d147cdeb935-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:06 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-d8062b50-3e4b-4e02-96c9-2d147cdeb935" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-d8062b50-3e4b-4e02-96c9-2d147cdeb935" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Deleting offline snapshot d8062b50-3e4b-4e02-96c9-2d147cdeb935 of volume be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] snapshot_file for this snap is: volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13acd88-d4b4-4d49-ab3c-7a338f2e7f5a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935" returned: 0 in 0.423s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae3c9c7-dba3-4a57-af0b-055110e49e5b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" returned: 0 in 0.406s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:07 devstack quobyte-client[82407]: System call of process 93134 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:19:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935" returned: 0 in 0.251s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea.d8062b50-3e4b-4e02-96c9-2d147cdeb935" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:07 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-d8062b50-3e4b-4e02-96c9-2d147cdeb935" released by "_delete_snapshot" :: held 1.443s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:07 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" released by "delete_snapshot" :: held 1.462s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Created reservations ['0265a2c1-1ccc-4f53-a6c1-2a75e05d6676', '6284bb1a-f394-4973-a453-23f1f1ca3336', 'a8298342-6ef1-4317-a149-666e1a99f60d', '7bfd2bdb-3f53-4c21-8f0e-3669984b54a8'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:19:08 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Delete snapshot completed successfully.
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a99c19f8-6f5c-478f-9667-84f38455937f tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-d8062b50-3e4b-4e02-96c9-2d147cdeb935-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:08 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "cinder-quobyte-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" acquired by "delete_volume" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c765f7c6-016a-4cae-8ea6-10d6dd649e4b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" returned: 0 in 0.389s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" returned: 0 in 0.125s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-quobyte-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea" released by "delete_volume" :: held 0.675s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Created reservations ['cf54c628-4955-4c7e-a443-51ef02422324', 'be9a5dd2-678a-409e-9485-ff7478165fc7', '513c9bde-2fd9-4ccf-ad7a-7dcd1aecb045', '6854b125-d3a8-4b71-8189-d1326aad8c9f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.129s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:09 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:19:09 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Deleted volume successfully.
Sep 03 08:19:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-677d6636-c5d5-4319-a683-5ec55ad6175e tempest-CreateVolumesFromSnapshotTest-243405246 None] Lock "cinder-be6c7fc1-15c4-4e7e-bd71-db9aff96a5ea-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Flow 'volume_create_manager' (4bf5f4fc-e379-41fa-bc33-abcc1b71e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2302c2-1b65-4e9a-b96d-f043398bb001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2302c2-1b65-4e9a-b96d-f043398bb001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1556957312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6af7b6-efe4-4e1b-a8e2-8942a5f768f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3071dbf2b91d45d594825d370a341d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:19:11Z,use_quota=True,user_id='c8f00ae1eb074b73bddc8dadff794e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d68c902-ce6d-4dbe-8771-c37ec95a44bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d68c902-ce6d-4dbe-8771-c37ec95a44bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557c2fad-3a58-4139-968f-12a0f2de9ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557c2fad-3a58-4139-968f-12a0f2de9ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6af7b6-efe4-4e1b-a8e2-8942a5f768f3', 'volume_name': 'volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444d059b-af06-4487-9a3f-80d6c4ba2c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444d059b-af06-4487-9a3f-80d6c4ba2c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f093a855-15ea-4cad-ae79-6d7e4ac62f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:11 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Volume af6af7b6-efe4-4e1b-a8e2-8942a5f768f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3', 'volume_size': 1}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1556957312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6af7b6-efe4-4e1b-a8e2-8942a5f768f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3071dbf2b91d45d594825d370a341d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:19:11Z,use_quota=True,user_id='c8f00ae1eb074b73bddc8dadff794e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Creating volume af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:19:11 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:11 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=89, name=volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 1073741824" returned: 0 in 0.423s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3" returned: 0 in 0.173s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] <== create_volume: return (659ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:19:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f093a855-15ea-4cad-ae79-6d7e4ac62f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a06a6c7-5707-466e-97d6-f6740405cb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:12 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Volume volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 (af6af7b6-efe4-4e1b-a8e2-8942a5f768f3): created successfully
Sep 03 08:19:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a06a6c7-5707-466e-97d6-f6740405cb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Flow 'volume_create_manager' (4bf5f4fc-e379-41fa-bc33-abcc1b71e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:19:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cf1b6cdc-be46-48cd-abea-7569741c7ded tempest-AttachVolumeTestJSON-1596917585 None] Created volume successfully.
Sep 03 08:19:15 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Flow 'volume_create_manager' (6786d45b-3f4b-4c9f-814c-18b0e6906862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a571bbcb-17bc-4e8c-8d0c-eb780b73f59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a571bbcb-17bc-4e8c-8d0c-eb780b73f59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd77440e-23bd-4cfa-9f18-55be01657bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9566700502482083edb9c63b7810d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:19:15Z,use_quota=True,user_id='f292bbea08174d54898278b3fae921d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ef5867-e30e-4465-9c22-1385248d4b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ef5867-e30e-4465-9c22-1385248d4b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ca4329-798e-4d1b-ad0f-f2465680fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ca4329-798e-4d1b-ad0f-f2465680fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd77440e-23bd-4cfa-9f18-55be01657bf1', 'volume_name': 'volume-cd77440e-23bd-4cfa-9f18-55be01657bf1', 'volume_size': 1, 'image_id': 'e5e985aa-c5ec-425a-ad19-db2209d93d89', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a691aef302c875bca22992fd25c25bdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d9566700502482083edb9c63b7810d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9c5821fe485ad0e80228621f7b573e9cc015524f9dadbefc5887e0f01902941b8b1323d7aec43974ffb755099d81500b041068af47a777af99a5a6ff70f4bb', 'id': 'e5e985aa-c5ec-425a-ad19-db2209d93d89', 'created_at': datetime.datetime(2025, 9, 3, 6, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 19, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5e985aa-c5ec-425a-ad19-db2209d93d89/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5ec3de40>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcc02c5-4f13-4783-9f8f-b81ef4e4c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcc02c5-4f13-4783-9f8f-b81ef4e4c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae267be-34ac-47fa-a1ef-2e36439e5777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:15 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Volume cd77440e-23bd-4cfa-9f18-55be01657bf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd77440e-23bd-4cfa-9f18-55be01657bf1', 'volume_size': 1, 'image_id': 'e5e985aa-c5ec-425a-ad19-db2209d93d89', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a691aef302c875bca22992fd25c25bdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d9566700502482083edb9c63b7810d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9c5821fe485ad0e80228621f7b573e9cc015524f9dadbefc5887e0f01902941b8b1323d7aec43974ffb755099d81500b041068af47a777af99a5a6ff70f4bb', 'id': 'e5e985aa-c5ec-425a-ad19-db2209d93d89', 'created_at': datetime.datetime(2025, 9, 3, 6, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 19, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5e985aa-c5ec-425a-ad19-db2209d93d89/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5ec3de40>}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Cloning cd77440e-23bd-4cfa-9f18-55be01657bf1 from image e5e985aa-c5ec-425a-ad19-db2209d93d89  at location (None, None). {{(pid=82397) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 03 08:19:15 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Image download 0.00 MB at 0.00 MB/s
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d382f6-1cf3-4cdf-8021-6ebe59ccceef]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:16 devstack sudo[93149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD
Sep 03 08:19:16 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:19:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:17 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48bb95-0e7d-4ab3-9cd1-9f75de9746b0]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:18 devstack quobyte-client[82407]: System call of process 93171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:19:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3" returned: 0 in 0.823s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:19 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root
Sep 03 08:19:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD" returned: 0 in 3.204s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5344c6f-5dec-4df8-8624-51f6e0d2744b', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:19:19 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:19 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-66f92cde-555f-4ba7-b1b8-adfae3f70217 req-61668569-9006-4dd9-8d5b-83ff8846601c tempest-AttachVolumeTestJSON-1596917585 None] attachment_update completed successfully.
Sep 03 08:19:19 devstack sudo[93176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD
Sep 03 08:19:19 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:19:21 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root
Sep 03 08:19:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD" returned: 1 in 2.359s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:19:21 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Temporary image e5e985aa-c5ec-425a-ad19-db2209d93d89 is fetched for user f292bbea08174d54898278b3fae921d3. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 03 08:19:21 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[16278083-b3d0-4578-8c96-47ea862c5c62]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:22 devstack sudo[93187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD
Sep 03 08:19:22 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:19:23 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root
Sep 03 08:19:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD" returned: 0 in 1.976s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:24 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD
Sep 03 08:19:24 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:19:25 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD" returned: 1 in 2.088s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd77440e-23bd-4cfa-9f18-55be01657bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9566700502482083edb9c63b7810d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:19:15Z,use_quota=True,user_id='f292bbea08174d54898278b3fae921d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Creating volume cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:19:25 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:19:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:26 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=90, name=volume-cd77440e-23bd-4cfa-9f18-55be01657bf1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 1073741824" returned: 0 in 0.283s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1" returned: 0 in 0.226s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] <== create_volume: return (585ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.616s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Attempting download of e5e985aa-c5ec-425a-ad19-db2209d93d89 ((None, None)) to volume cd77440e-23bd-4cfa-9f18-55be01657bf1. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c33f73-c071-4166-97c8-fbc46ec2cbdf]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5e985aa-c5ec-425a-ad19-db2209d93d89_mzd80glv {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5e985aa-c5ec-425a-ad19-db2209d93d89_mzd80glv" returned: 0 in 0.393s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5e985aa-c5ec-425a-ad19-db2209d93d89_mzd80glv {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5e985aa-c5ec-425a-ad19-db2209d93d89_mzd80glv" returned: 1 in 0.405s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5e985aa-c5ec-425a-ad19-db2209d93d89_mzd80glv' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:19:27 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fd1e1a-f23a-46e8-86aa-750a3d8203bb]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] e5e985aa-c5ec-425a-ad19-db2209d93d89 was raw, converting to raw {{(pid=82397) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:28 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=90, name=volume-cd77440e-23bd-4cfa-9f18-55be01657bf1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1" returned: 0 in 0.166s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5e985aa-c5ec-425a-ad19-db2209d93d89_fj2yhw80devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:19:28 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Converted 0.00 MB image at 0.00 MB/s
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 1G" returned: 0 in 0.143s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[df70f2ca-a57b-48dd-b128-3d2ee56b2cbd]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1" returned: 0 in 0.339s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1" returned: 1 in 0.339s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Downloaded image e5e985aa-c5ec-425a-ad19-db2209d93d89 ((None, None)) to volume cd77440e-23bd-4cfa-9f18-55be01657bf1 successfully. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Temporary image e5e985aa-c5ec-425a-ad19-db2209d93d89 for user f292bbea08174d54898278b3fae921d3 is deleted. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Marking volume cd77440e-23bd-4cfa-9f18-55be01657bf1 as bootable. {{(pid=82397) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Copying metadata from image e5e985aa-c5ec-425a-ad19-db2209d93d89 to cd77440e-23bd-4cfa-9f18-55be01657bf1. {{(pid=82397) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Creating volume glance metadata for volume cd77440e-23bd-4cfa-9f18-55be01657bf1 backed by image e5e985aa-c5ec-425a-ad19-db2209d93d89 with: {'image_id': 'e5e985aa-c5ec-425a-ad19-db2209d93d89', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a691aef302c875bca22992fd25c25bdf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82397) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae267be-34ac-47fa-a1ef-2e36439e5777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd77440e-23bd-4cfa-9f18-55be01657bf1', 'volume_size': 1, 'image_id': 'e5e985aa-c5ec-425a-ad19-db2209d93d89', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a691aef302c875bca22992fd25c25bdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d9566700502482083edb9c63b7810d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9c5821fe485ad0e80228621f7b573e9cc015524f9dadbefc5887e0f01902941b8b1323d7aec43974ffb755099d81500b041068af47a777af99a5a6ff70f4bb', 'id': 'e5e985aa-c5ec-425a-ad19-db2209d93d89', 'created_at': datetime.datetime(2025, 9, 3, 6, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 19, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5e985aa-c5ec-425a-ad19-db2209d93d89/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5ec3de40>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aac8822-d1db-4786-9186-8b0ca5e07de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:19:30 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Volume volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 (cd77440e-23bd-4cfa-9f18-55be01657bf1): created successfully
Sep 03 08:19:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aac8822-d1db-4786-9186-8b0ca5e07de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:19:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Flow 'volume_create_manager' (6786d45b-3f4b-4c9f-814c-18b0e6906862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:19:30 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-75394a77-8976-40b0-91bb-f37d5cee0bb3 tempest-VolumeImageDependencyTests-766705301 None] Created volume successfully.
Sep 03 08:19:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Acquiring lock "cinder-cd77440e-23bd-4cfa-9f18-55be01657bf1-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Lock "cinder-cd77440e-23bd-4cfa-9f18-55be01657bf1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:31 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Acquiring lock "cinder-quobyte-cd77440e-23bd-4cfa-9f18-55be01657bf1" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Lock "cinder-quobyte-cd77440e-23bd-4cfa-9f18-55be01657bf1" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb8bb9b-cec8-40e7-a575-f3621b9f242d]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1" returned: 0 in 0.354s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1" returned: 1 in 0.359s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:19:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cd77440e-23bd-4cfa-9f18-55be01657bf1" returned: 0 in 0.093s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Lock "cinder-quobyte-cd77440e-23bd-4cfa-9f18-55be01657bf1" released by "delete_volume" :: held 1.011s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Created reservations ['ef642f63-d78a-4d88-a618-a2a2b4edbd19', '507d32f1-ce19-4069-a910-2de03ce785b7', 'c5a8c512-0d4c-4256-a306-d23ae4b34bf8', '3459634c-bf43-453c-8c3b-7fb23aa64c90'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.088s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:19:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Deleted volume successfully.
Sep 03 08:19:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10cfc938-f12f-45ea-8e24-628d41a674fa tempest-VolumeImageDependencyTests-766705301 None] Lock "cinder-cd77440e-23bd-4cfa-9f18-55be01657bf1-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:19:42 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=67,cinder:UPDATE=92,cinder:DELETE=9,cinder:INSERT=21 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:19:42 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=79,cinder:DELETE=8,cinder:SELECT=67,cinder:INSERT=20 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:19:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-b3580047-42da-4e96-9e6d-9ae2cacde077 req-c8701920-19d5-433d-9a36-880c68c77774 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-b3580047-42da-4e96-9e6d-9ae2cacde077 req-c8701920-19d5-433d-9a36-880c68c77774 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:19:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-b3580047-42da-4e96-9e6d-9ae2cacde077 req-c8701920-19d5-433d-9a36-880c68c77774 tempest-AttachVolumeTestJSON-1596917585 None] Terminate volume connection completed successfully.
Sep 03 08:19:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-b3580047-42da-4e96-9e6d-9ae2cacde077 req-c8701920-19d5-433d-9a36-880c68c77774 tempest-AttachVolumeTestJSON-1596917585 None] Deleting attachment 395b3f96-1e0e-4d5b-82ab-f337302d4454. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.093s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:19:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:19:57 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:20:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-4311e671-4687-4c18-8d7f-a844d71fa571 req-6300e673-105e-44de-9737-fd17e0f75092 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:20:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-4311e671-4687-4c18-8d7f-a844d71fa571 req-6300e673-105e-44de-9737-fd17e0f75092 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:20:11 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-4311e671-4687-4c18-8d7f-a844d71fa571 req-6300e673-105e-44de-9737-fd17e0f75092 tempest-AttachVolumeTestJSON-1596917585 None] Terminate volume connection completed successfully.
Sep 03 08:20:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4311e671-4687-4c18-8d7f-a844d71fa571 req-6300e673-105e-44de-9737-fd17e0f75092 tempest-AttachVolumeTestJSON-1596917585 None] Deleting attachment a5344c6f-5dec-4df8-8624-51f6e0d2744b. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:20:21 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:20:21 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:20:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "cinder-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:20:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:20:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:20:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "cinder-quobyte-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:20:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-quobyte-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3" acquired by "delete_volume" :: waited 0.017s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:20:23 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c6f2c4-684b-4509-940d-32acbae53bdb]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:20:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3" returned: 0 in 0.404s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-quobyte-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3" released by "delete_volume" :: held 0.648s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Created reservations ['9fb0e95a-4cbd-4b48-a67a-d558cfccf1c1', '6daa8a9f-be9f-478e-8f26-dc9d9d9efaf5', '1f7a0a73-58a6-4c80-b48e-babd809c0d8b', '1fbcaab4-4808-4910-838d-c6a668d2051f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:24 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:20:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Deleted volume successfully.
Sep 03 08:20:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b35c3dd-1ab7-4275-bedb-55beb66c62b4 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-af6af7b6-efe4-4e1b-a8e2-8942a5f768f3-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:20:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "cinder-d4b09775-9267-4c7f-b484-9e8522d29b42-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-d4b09775-9267-4c7f-b484-9e8522d29b42-delete_volume" acquired by "delete_volume" :: waited 0.258s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:20:26 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "cinder-quobyte-d4b09775-9267-4c7f-b484-9e8522d29b42" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-quobyte-d4b09775-9267-4c7f-b484-9e8522d29b42" acquired by "delete_volume" :: waited 0.017s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7234af3-08a3-4539-866b-f73b71d3524b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42" returned: 0 in 0.432s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d4b09775-9267-4c7f-b484-9e8522d29b42" returned: 0 in 0.098s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:26 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-quobyte-d4b09775-9267-4c7f-b484-9e8522d29b42" released by "delete_volume" :: held 0.658s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Created reservations ['0f37cd3b-7e0c-432f-89b5-5553e32964ef', '9a086fec-a300-48c7-83b5-0d75a8bafecc', '80ce48d9-9e5a-4cdb-b858-4957baf3170d', '0b6ee72c-0af6-4e95-9dd7-28f7732c1881'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.097s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:20:27 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Deleted volume successfully.
Sep 03 08:20:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-926dd584-30a4-4dd3-b90d-232f1608781d tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-d4b09775-9267-4c7f-b484-9e8522d29b42-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "cinder-9e358b1a-b12e-40f1-a7de-59ededdaab37-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-9e358b1a-b12e-40f1-a7de-59ededdaab37-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:20:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "cinder-quobyte-9e358b1a-b12e-40f1-a7de-59ededdaab37" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-quobyte-9e358b1a-b12e-40f1-a7de-59ededdaab37" acquired by "delete_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0255e12c-c942-4c3d-85a5-c6d25fbc8acc]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37" returned: 0 in 0.379s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9e358b1a-b12e-40f1-a7de-59ededdaab37" returned: 0 in 0.102s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-quobyte-9e358b1a-b12e-40f1-a7de-59ededdaab37" released by "delete_volume" :: held 0.656s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Created reservations ['a6a90f8c-8616-4f70-a9bb-3840e62587fa', 'acbd6bc7-ffa8-44ab-8023-e45e8fa2c8f8', '57307881-37e0-41dd-a2f7-5426b4035b02', 'f5a2b339-ae69-4b88-b7db-1e0ac7a31906'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.089s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:20:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Deleted volume successfully.
Sep 03 08:20:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3d709ee-8a5c-4b8a-abb8-4ef0f21c2696 tempest-AttachVolumeTestJSON-1596917585 None] Lock "cinder-9e358b1a-b12e-40f1-a7de-59ededdaab37-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:20:39 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:20:39 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=26,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.100s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:20:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:21:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:21:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:21:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:22:20 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Flow 'volume_create_manager' (d6969cff-ebe0-40a6-a00c-b7fb79d2c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3656f3fa-eee3-4e7c-81c7-38778e84c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3656f3fa-eee3-4e7c-81c7-38778e84c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-759238459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ca10db-cea3-4899-abe5-60aaa0cd1bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0674df0a04d7aaa1402627ba83cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:22:20Z,use_quota=True,user_id='e389f93b6c3b4130a299eef684ff5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea92764-1cf9-46db-bec5-7351b9e34424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea92764-1cf9-46db-bec5-7351b9e34424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48822415-599f-4601-80fe-29e771f37ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48822415-599f-4601-80fe-29e771f37ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ca10db-cea3-4899-abe5-60aaa0cd1bc4', 'volume_name': 'volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb85fbe-eb35-487d-a76d-aefc7c851d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb85fbe-eb35-487d-a76d-aefc7c851d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae51c16a-13a3-4ea5-954d-f4a32339a307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:22:20 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Volume 28ca10db-cea3-4899-abe5-60aaa0cd1bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4', 'volume_size': 1}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-759238459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ca10db-cea3-4899-abe5-60aaa0cd1bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0674df0a04d7aaa1402627ba83cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:22:20Z,use_quota=True,user_id='e389f93b6c3b4130a299eef684ff5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Creating volume 28ca10db-cea3-4899-abe5-60aaa0cd1bc4 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:22:20 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:22:20 devstack quobyte-client[82407]: System call of process 93649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:22:20 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=91, name=volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4 1073741824" returned: 0 in 0.459s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:22:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:22:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4" returned: 0 in 0.157s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:22:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] <== create_volume: return (700ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:22:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:22:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae51c16a-13a3-4ea5-954d-f4a32339a307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:22:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3444247b-e9a3-416b-a8a0-5e75666c3260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:22:21 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Volume volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4 (28ca10db-cea3-4899-abe5-60aaa0cd1bc4): created successfully
Sep 03 08:22:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3444247b-e9a3-416b-a8a0-5e75666c3260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:22:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Flow 'volume_create_manager' (d6969cff-ebe0-40a6-a00c-b7fb79d2c119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:22:21 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4ecfccbf-2746-42cb-a76a-8ecd12489eca tempest-AttachVolumeNegativeTest-116718511 None] Created volume successfully.
Sep 03 08:22:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:22:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:22:26 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81a4b16-92dc-4bee-b9de-be6f027847b2]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:22:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:22:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4" returned: 0 in 0.397s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:22:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.450s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:22:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36fd71d9-7331-415f-b168-23aacff9aa64', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:22:26 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:22:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-1603613b-f38a-4765-a5fe-6f83bdb35965 req-34c504f8-1ae6-46df-99b6-6c153fd934ce tempest-AttachVolumeNegativeTest-116718511 None] attachment_update completed successfully.
Sep 03 08:22:36 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:22:36 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.090s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:22:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:23:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:23:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.093s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:23:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:24:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-fb1da2bb-b5fa-43cb-bf10-9559b14c36be req-79a870fb-d748-4984-afed-18edabde8e90 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:24:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-fb1da2bb-b5fa-43cb-bf10-9559b14c36be req-79a870fb-d748-4984-afed-18edabde8e90 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:24:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-fb1da2bb-b5fa-43cb-bf10-9559b14c36be req-79a870fb-d748-4984-afed-18edabde8e90 tempest-AttachVolumeNegativeTest-116718511 None] Terminate volume connection completed successfully.
Sep 03 08:24:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-fb1da2bb-b5fa-43cb-bf10-9559b14c36be req-79a870fb-d748-4984-afed-18edabde8e90 tempest-AttachVolumeNegativeTest-116718511 None] Deleting attachment 36fd71d9-7331-415f-b168-23aacff9aa64. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:24:46 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.128s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:24:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:25:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:25:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:26:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Flow 'volume_create_manager' (a93da616-e3fb-4122-a97d-8bee27c0c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f48c73-8e7b-4ba7-a786-e1504213f763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f48c73-8e7b-4ba7-a786-e1504213f763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1482846581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd104f81-3e8f-4351-a83f-7f06eaee24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0674df0a04d7aaa1402627ba83cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:26:22Z,use_quota=True,user_id='e389f93b6c3b4130a299eef684ff5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ae5d53-7e85-43f4-96cd-787c95191c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ae5d53-7e85-43f4-96cd-787c95191c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21716658-9966-449d-9616-7cbdcd36e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21716658-9966-449d-9616-7cbdcd36e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd104f81-3e8f-4351-a83f-7f06eaee24c3', 'volume_name': 'volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0c97a1-e002-4a10-b67e-1dc3cc8125ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0c97a1-e002-4a10-b67e-1dc3cc8125ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae9f0ec-3449-4add-8d2b-9c611bdd01f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:26:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Volume bd104f81-3e8f-4351-a83f-7f06eaee24c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3', 'volume_size': 1}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1482846581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd104f81-3e8f-4351-a83f-7f06eaee24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0674df0a04d7aaa1402627ba83cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:26:22Z,use_quota=True,user_id='e389f93b6c3b4130a299eef684ff5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Creating volume bd104f81-3e8f-4351-a83f-7f06eaee24c3 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:26:22 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:26:22 devstack quobyte-client[82407]: System call of process 94926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:26:22 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=92, name=volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3 1073741824" returned: 0 in 0.391s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3" returned: 0 in 0.075s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] <== create_volume: return (522ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae9f0ec-3449-4add-8d2b-9c611bdd01f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c10690-cef0-4209-82b8-be2050a32a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:26:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Volume volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3 (bd104f81-3e8f-4351-a83f-7f06eaee24c3): created successfully
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c10690-cef0-4209-82b8-be2050a32a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:26:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Flow 'volume_create_manager' (a93da616-e3fb-4122-a97d-8bee27c0c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:26:22 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-04adf571-2ae6-4693-af4b-fbba61b85bba tempest-AttachVolumeNegativeTest-116718511 None] Created volume successfully.
Sep 03 08:26:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:26:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:26:27 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5629fe92-7a69-4dbe-a8c9-b3cea0309f91]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:26:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:26:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3" returned: 0 in 0.382s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:26:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.439s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:26:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8173d1b-a33e-4b84-b148-e1629fe9dabe', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:26:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:26:28 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-393ea5fe-15aa-4cb5-908c-31dc7e8bef0e req-f303e8be-ebcc-45b8-a2f7-bf78708386d9 tempest-AttachVolumeNegativeTest-116718511 None] attachment_update completed successfully.
Sep 03 08:26:38 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:26:38 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.112s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:26:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:26:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-889536f8-c087-4ebc-bf1e-fdf1e530b7d3 req-a1136b88-b6f1-4791-9689-4f38a9aa0b62 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:26:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-889536f8-c087-4ebc-bf1e-fdf1e530b7d3 req-a1136b88-b6f1-4791-9689-4f38a9aa0b62 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:26:56 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-889536f8-c087-4ebc-bf1e-fdf1e530b7d3 req-a1136b88-b6f1-4791-9689-4f38a9aa0b62 tempest-AttachVolumeNegativeTest-116718511 None] Terminate volume connection completed successfully.
Sep 03 08:26:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-889536f8-c087-4ebc-bf1e-fdf1e530b7d3 req-a1136b88-b6f1-4791-9689-4f38a9aa0b62 tempest-AttachVolumeNegativeTest-116718511 None] Deleting attachment e8173d1b-a33e-4b84-b148-e1629fe9dabe. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:27:06 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:27:06 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.108s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:27:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:28:42 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Flow 'volume_create_manager' (bffd390f-55b1-4ca6-9cd3-df4df3136aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72a5357-9147-46d6-9aa8-f18715ec714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72a5357-9147-46d6-9aa8-f18715ec714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191521951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52103582-af8c-4b30-8edb-db3dc697cc36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0674df0a04d7aaa1402627ba83cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:28:43Z,use_quota=True,user_id='e389f93b6c3b4130a299eef684ff5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24b12e1-6bab-4eab-9b06-777f84a69fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24b12e1-6bab-4eab-9b06-777f84a69fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa80d698-480f-4a78-a133-263c6b25f556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa80d698-480f-4a78-a133-263c6b25f556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52103582-af8c-4b30-8edb-db3dc697cc36', 'volume_name': 'volume-52103582-af8c-4b30-8edb-db3dc697cc36', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1670985c-6d2d-4aaf-bc5a-b683c271899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1670985c-6d2d-4aaf-bc5a-b683c271899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba833e2b-9765-4b67-8362-596f2f7fece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:28:42 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Volume 52103582-af8c-4b30-8edb-db3dc697cc36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52103582-af8c-4b30-8edb-db3dc697cc36', 'volume_size': 1}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191521951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52103582-af8c-4b30-8edb-db3dc697cc36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0674df0a04d7aaa1402627ba83cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:28:43Z,use_quota=True,user_id='e389f93b6c3b4130a299eef684ff5e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Creating volume 52103582-af8c-4b30-8edb-db3dc697cc36 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:28:42 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:28:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:28:43 devstack quobyte-client[82407]: System call of process 95665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:28:43 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=93, name=volume-52103582-af8c-4b30-8edb-db3dc697cc36, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36 1073741824" returned: 0 in 0.378s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] <== create_volume: return (522ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba833e2b-9765-4b67-8362-596f2f7fece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52103582-af8c-4b30-8edb-db3dc697cc36', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f195bc3c-d203-47cd-b8cf-d9c87060bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:28:43 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Volume volume-52103582-af8c-4b30-8edb-db3dc697cc36 (52103582-af8c-4b30-8edb-db3dc697cc36): created successfully
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f195bc3c-d203-47cd-b8cf-d9c87060bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:28:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Flow 'volume_create_manager' (bffd390f-55b1-4ca6-9cd3-df4df3136aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:28:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f0d851a8-25a2-4f7b-a35d-0ceccab262ce tempest-AttachVolumeNegativeTest-116718511 None] Created volume successfully.
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f140d7ce-f547-44b1-9b77-377adba1ef70]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:28:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:28:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36" returned: 0 in 0.475s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:28:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.516s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:28:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-52103582-af8c-4b30-8edb-db3dc697cc36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2aa9efd4-19c4-420d-a609-e5fcffd1718e', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:28:49 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:28:49 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-79369eb8-bbce-4708-ba5d-ef245cee5141 req-1f657f95-d8c5-4799-89bb-19165d12f66c tempest-AttachVolumeNegativeTest-116718511 None] attachment_update completed successfully.
Sep 03 08:29:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:29:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:29:18 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-ec4923c4-f01e-4e21-be06-fab79152d2ec req-32b227f7-283f-4341-8d63-9daba7d330db tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:18 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-ec4923c4-f01e-4e21-be06-fab79152d2ec req-32b227f7-283f-4341-8d63-9daba7d330db tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:18 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-ec4923c4-f01e-4e21-be06-fab79152d2ec req-32b227f7-283f-4341-8d63-9daba7d330db tempest-AttachVolumeNegativeTest-116718511 None] Terminate volume connection completed successfully.
Sep 03 08:29:18 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-ec4923c4-f01e-4e21-be06-fab79152d2ec req-32b227f7-283f-4341-8d63-9daba7d330db tempest-AttachVolumeNegativeTest-116718511 None] Deleting attachment 2aa9efd4-19c4-420d-a609-e5fcffd1718e. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:29:28 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:29:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "cinder-52103582-af8c-4b30-8edb-db3dc697cc36-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-52103582-af8c-4b30-8edb-db3dc697cc36-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:31 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "cinder-quobyte-52103582-af8c-4b30-8edb-db3dc697cc36" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-quobyte-52103582-af8c-4b30-8edb-db3dc697cc36" acquired by "delete_volume" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5857c926-60a5-46d8-98e1-569cc56d3766]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36" returned: 0 in 0.418s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-52103582-af8c-4b30-8edb-db3dc697cc36" returned: 0 in 0.099s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-quobyte-52103582-af8c-4b30-8edb-db3dc697cc36" released by "delete_volume" :: held 0.650s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:32 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Created reservations ['77fc7cd0-d16a-46ee-ab69-0bb00bafc44f', '74dc06b4-b76c-45f4-a9e0-9b4e36c69d1c', 'f7504259-e9cd-48d3-8be4-3d92c06a6eea', 'fb249973-c30f-48b8-af7d-c75ea0145f07'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:29:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Deleted volume successfully.
Sep 03 08:29:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-93fbab9c-3838-4d83-b4df-b0c31c5b8357 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-52103582-af8c-4b30-8edb-db3dc697cc36-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "cinder-bd104f81-3e8f-4351-a83f-7f06eaee24c3-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-bd104f81-3e8f-4351-a83f-7f06eaee24c3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:34 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "cinder-quobyte-bd104f81-3e8f-4351-a83f-7f06eaee24c3" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-quobyte-bd104f81-3e8f-4351-a83f-7f06eaee24c3" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f79ce5-8685-4f41-93fd-524709fd21a2]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3" returned: 0 in 0.399s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-bd104f81-3e8f-4351-a83f-7f06eaee24c3" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-quobyte-bd104f81-3e8f-4351-a83f-7f06eaee24c3" released by "delete_volume" :: held 0.621s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Created reservations ['cc784e08-8928-485a-9795-2ce711c9736b', '662d6fe7-57a5-4b06-b6db-2907eb578b7e', 'a452154c-2283-4367-90db-6f36dd3b2188', '183ce7cc-cccf-4bff-bf89-070f1cdce4b9'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.143s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:29:35 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Deleted volume successfully.
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "cinder-28ca10db-cea3-4899-abe5-60aaa0cd1bc4-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e592559c-07a2-4d92-bb69-62b47ebf2747 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-bd104f81-3e8f-4351-a83f-7f06eaee24c3-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-28ca10db-cea3-4899-abe5-60aaa0cd1bc4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "cinder-quobyte-28ca10db-cea3-4899-abe5-60aaa0cd1bc4" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-quobyte-28ca10db-cea3-4899-abe5-60aaa0cd1bc4" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[76889dec-b2cc-46f6-83c1-bfa74290cbe3]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:36 devstack quobyte-client[82407]: System call of process 96239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4" returned: 0 in 0.418s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28ca10db-cea3-4899-abe5-60aaa0cd1bc4" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-quobyte-28ca10db-cea3-4899-abe5-60aaa0cd1bc4" released by "delete_volume" :: held 0.649s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:36 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Created reservations ['477b834a-08ad-4a85-8c9d-c32037cfad8b', 'd87bc360-a5fa-44ef-88e8-604f233a2df5', '2dd52813-2694-489c-bffa-9c7fc0583999', '79ac92ce-04e9-4a78-aae7-a1d843f9cc3e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:29:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Deleted volume successfully.
Sep 03 08:29:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-56e33809-2e28-4c42-8bb1-4d383bcd2fd7 tempest-AttachVolumeNegativeTest-116718511 None] Lock "cinder-28ca10db-cea3-4899-abe5-60aaa0cd1bc4-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Flow 'volume_create_manager' (262dc5c2-84a5-4355-a8bd-6b47c28592b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fc6305-71d0-4902-8bb5-f42fd0054a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fc6305-71d0-4902-8bb5-f42fd0054a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2049302915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e7b1b1-d147-4a0d-a1ad-433a497af80d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a9040d608db4ed090c5f3e62c9ebb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:45Z,use_quota=True,user_id='a1db76b7d3644489a80cc11d8c97d3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b891a18-2fe9-431a-a328-2e28c33d3743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b891a18-2fe9-431a-a328-2e28c33d3743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d076733-261a-40bc-ac59-d94a0d3eef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d076733-261a-40bc-ac59-d94a0d3eef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e7b1b1-d147-4a0d-a1ad-433a497af80d', 'volume_name': 'volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366e50dd-3a3c-49cb-8214-8823ad776f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366e50dd-3a3c-49cb-8214-8823ad776f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb170ab-5b6f-4653-949d-c40d68049b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:45 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Volume 88e7b1b1-d147-4a0d-a1ad-433a497af80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d', 'volume_size': 1}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2049302915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e7b1b1-d147-4a0d-a1ad-433a497af80d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a9040d608db4ed090c5f3e62c9ebb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:45Z,use_quota=True,user_id='a1db76b7d3644489a80cc11d8c97d3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Creating volume 88e7b1b1-d147-4a0d-a1ad-433a497af80d {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:29:45 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:29:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:45 devstack quobyte-client[82407]: System call of process 96253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:29:45 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=94, name=volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d 1073741824" returned: 0 in 0.315s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d" returned: 0 in 0.089s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] <== create_volume: return (462ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.472s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb170ab-5b6f-4653-949d-c40d68049b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddce0921-d200-408e-a076-ab4a7d5f7dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:46 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Volume volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d (88e7b1b1-d147-4a0d-a1ad-433a497af80d): created successfully
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddce0921-d200-408e-a076-ab4a7d5f7dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Flow 'volume_create_manager' (262dc5c2-84a5-4355-a8bd-6b47c28592b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-4fd191be-e949-4f14-b720-fed6b7f827c5 req-17603407-c577-4e15-a601-a3603a274fb1 tempest-VolumesGetTestJSON-1926059144 None] Created volume successfully.
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Acquiring lock "cinder-88e7b1b1-d147-4a0d-a1ad-433a497af80d-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Lock "cinder-88e7b1b1-d147-4a0d-a1ad-433a497af80d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Acquiring lock "cinder-quobyte-88e7b1b1-d147-4a0d-a1ad-433a497af80d" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Lock "cinder-quobyte-88e7b1b1-d147-4a0d-a1ad-433a497af80d" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[01251936-291e-4070-8b9c-cb7669deab0f]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:29:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d" returned: 0 in 0.386s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-88e7b1b1-d147-4a0d-a1ad-433a497af80d" returned: 0 in 0.098s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Lock "cinder-quobyte-88e7b1b1-d147-4a0d-a1ad-433a497af80d" released by "delete_volume" :: held 0.610s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG cinder.quota [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Created reservations ['e2c055da-8faf-4110-ba3a-d29bcf8a04e9', 'ca2a3d10-ad15-4930-a9d5-7192f092ca48', 'ddc08b56-1666-4d15-9ac7-cd1b655ffae8', '3ce5f39e-921c-474f-9a30-8b7f9a11ae86'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.132s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:47 devstack cinder-volume[82397]: DEBUG cinder.manager [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:29:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Deleted volume successfully.
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [req-4989526c-417c-4e01-bc34-1e2fa9f9c754 req-9e9c7e19-9aff-486d-a0f3-a5f36bd2f9c5 tempest-VolumesGetTestJSON-1926059144 None] Lock "cinder-88e7b1b1-d147-4a0d-a1ad-433a497af80d-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:29:51 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:51 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:29:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Flow 'volume_create_manager' (aef77879-940c-4c9f-ab79-982edf0f5a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9748bdb-3b59-4176-93e4-3d3c8fc109c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9748bdb-3b59-4176-93e4-3d3c8fc109c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-760721451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6570e88f-f3e7-41d5-98c4-94f14a7bc077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b747b308e36149c8a490ae68e8b798a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:51Z,use_quota=True,user_id='1590fed18ec04500ae7e266124270697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677debb-ae2d-4e13-9cd1-4d67353734a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677debb-ae2d-4e13-9cd1-4d67353734a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa61dd2d-cb27-4ba4-ab61-742265c8b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa61dd2d-cb27-4ba4-ab61-742265c8b1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6570e88f-f3e7-41d5-98c4-94f14a7bc077', 'volume_name': 'volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98c9f67-8da5-4e49-8567-b5e7d51f2947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98c9f67-8da5-4e49-8567-b5e7d51f2947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8643d5-240c-40ea-a245-e3f6b7566209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:52 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Volume 6570e88f-f3e7-41d5-98c4-94f14a7bc077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077', 'volume_size': 1}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-760721451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6570e88f-f3e7-41d5-98c4-94f14a7bc077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b747b308e36149c8a490ae68e8b798a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:51Z,use_quota=True,user_id='1590fed18ec04500ae7e266124270697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Creating volume 6570e88f-f3e7-41d5-98c4-94f14a7bc077 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:29:52 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:52 devstack quobyte-client[82407]: System call of process 96295 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:29:52 devstack quobyte-client[82407]: System call of process 96295 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:29:52 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=95, name=volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077 1073741824" returned: 0 in 0.341s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] <== create_volume: return (486ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.499s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8643d5-240c-40ea-a245-e3f6b7566209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941d29f2-af4d-4523-8d9c-ed791cfc4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:52 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Volume volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077 (6570e88f-f3e7-41d5-98c4-94f14a7bc077): created successfully
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941d29f2-af4d-4523-8d9c-ed791cfc4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Flow 'volume_create_manager' (aef77879-940c-4c9f-ab79-982edf0f5a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e6262bee-b940-485c-9285-4419eb5c2e46 tempest-VolumesTestJSON-1656337256 None] Created volume successfully.
Sep 03 08:29:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Flow 'volume_create_manager' (2046de6a-8f28-48fe-a2a1-e7e5c92c1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f40c2dc-153b-44a0-ad50-90f1c235296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f40c2dc-153b-44a0-ad50-90f1c235296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-833911922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b747b308e36149c8a490ae68e8b798a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:54Z,use_quota=True,user_id='1590fed18ec04500ae7e266124270697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a1f5f5-19e3-4a51-a2af-0187d7cfc4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a1f5f5-19e3-4a51-a2af-0187d7cfc4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d92b65-e300-44be-8ec1-748cfaaebee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d92b65-e300-44be-8ec1-748cfaaebee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9', 'volume_name': 'volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6347b1-7be2-4766-a5d2-bd69b8a518e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6347b1-7be2-4766-a5d2-bd69b8a518e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ecb77d-fea4-4001-8c99-59dad8e73bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:54 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Volume 6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9', 'volume_size': 1}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-833911922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b747b308e36149c8a490ae68e8b798a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:54Z,use_quota=True,user_id='1590fed18ec04500ae7e266124270697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Creating volume 6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:29:54 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:54 devstack quobyte-client[82407]: System call of process 96300 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:29:54 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=96, name=volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9 1073741824" returned: 0 in 0.325s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9" returned: 0 in 0.078s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] <== create_volume: return (462ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.473s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ecb77d-fea4-4001-8c99-59dad8e73bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fc2967-83e8-4e6c-8416-74f44752da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:55 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Volume volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9 (6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9): created successfully
Sep 03 08:29:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fc2967-83e8-4e6c-8416-74f44752da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:55 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Flow 'volume_create_manager' (2046de6a-8f28-48fe-a2a1-e7e5c92c1048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:55 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-60ac7b85-2704-412a-b7f1-f4e81adad27d tempest-VolumesTestJSON-1656337256 None] Created volume successfully.
Sep 03 08:29:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Flow 'volume_create_manager' (f38679c6-449d-4a39-b480-5d246688e43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81194de1-5a6a-4255-a442-7fb5dc1b0844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81194de1-5a6a-4255-a442-7fb5dc1b0844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1184280386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985449f2-8258-4cac-8fb1-7fddf478919a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b747b308e36149c8a490ae68e8b798a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:56Z,use_quota=True,user_id='1590fed18ec04500ae7e266124270697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d34ae7-4d22-44b5-8d5a-a54363a4b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d34ae7-4d22-44b5-8d5a-a54363a4b62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9aa88de-bd62-4456-979f-4a0619768a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9aa88de-bd62-4456-979f-4a0619768a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985449f2-8258-4cac-8fb1-7fddf478919a', 'volume_name': 'volume-985449f2-8258-4cac-8fb1-7fddf478919a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25039d4d-0fa0-45fe-8434-2c801a93b29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25039d4d-0fa0-45fe-8434-2c801a93b29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbffe4f-6472-4d1e-be5c-67651c61e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:56 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Volume 985449f2-8258-4cac-8fb1-7fddf478919a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985449f2-8258-4cac-8fb1-7fddf478919a', 'volume_size': 1}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1184280386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985449f2-8258-4cac-8fb1-7fddf478919a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b747b308e36149c8a490ae68e8b798a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:29:56Z,use_quota=True,user_id='1590fed18ec04500ae7e266124270697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Creating volume 985449f2-8258-4cac-8fb1-7fddf478919a {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:29:56 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:56 devstack quobyte-client[82407]: System call of process 96304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:29:56 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=97, name=volume-985449f2-8258-4cac-8fb1-7fddf478919a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a 1073741824" returned: 0 in 0.329s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a" returned: 0 in 0.075s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] <== create_volume: return (460ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.471s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbffe4f-6472-4d1e-be5c-67651c61e116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985449f2-8258-4cac-8fb1-7fddf478919a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b12dc73-ad00-4b1e-83e3-645b15bc13f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:29:56 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Volume volume-985449f2-8258-4cac-8fb1-7fddf478919a (985449f2-8258-4cac-8fb1-7fddf478919a): created successfully
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b12dc73-ad00-4b1e-83e3-645b15bc13f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:29:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Flow 'volume_create_manager' (f38679c6-449d-4a39-b480-5d246688e43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:29:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-dcc22f9b-96a0-4155-aafb-818604d9b37d tempest-VolumesTestJSON-1656337256 None] Created volume successfully.
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "cinder-985449f2-8258-4cac-8fb1-7fddf478919a-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-985449f2-8258-4cac-8fb1-7fddf478919a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:58 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "cinder-quobyte-985449f2-8258-4cac-8fb1-7fddf478919a" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-quobyte-985449f2-8258-4cac-8fb1-7fddf478919a" acquired by "delete_volume" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f2af92-2d2e-490a-92a4-a795f8b3614b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a" returned: 0 in 0.389s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-985449f2-8258-4cac-8fb1-7fddf478919a" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-quobyte-985449f2-8258-4cac-8fb1-7fddf478919a" released by "delete_volume" :: held 0.602s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Created reservations ['c9a7761e-c0e3-401a-9b0f-72a8c70c61fc', 'd778486c-3cf1-48b5-be00-0d1d1558ce5d', '0e5ac2ad-73ec-4b64-a017-0d8853b900b3', '16361344-63bd-4a61-b7e3-1515c734f445'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Acquiring lock "cinder-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.328s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Lock "cinder-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:59 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Deleted volume successfully.
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-876bf7cd-f6b9-40bd-9b2d-5561ade3a384 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-985449f2-8258-4cac-8fb1-7fddf478919a-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:29:59 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Acquiring lock "cinder-quobyte-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Lock "cinder-quobyte-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9" acquired by "delete_volume" :: waited 0.020s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f71e5a-5e6f-4c66-ba87-080994e0a3e9]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:29:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9" returned: 0 in 0.370s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Lock "cinder-quobyte-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9" released by "delete_volume" :: held 0.578s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Created reservations ['d10227cc-6fee-4b2c-a3b7-eebc819c5642', 'f8762ed1-bfa3-4b01-acc6-0c6a797be108', '1e684e85-0061-44ad-8d23-b4092a90ab52', '8557ba44-58a1-4be6-8c16-520d818f470f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.077s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:00 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:00 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Deleted volume successfully.
Sep 03 08:30:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-6ba7b802-e7ea-492f-b19b-9239993f6aac tempest-VolumesTestJSON-1656337256 None] Lock "cinder-6b8a832d-c1cf-4d10-a5a4-8b7fb5c3d4c9-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "cinder-6570e88f-f3e7-41d5-98c4-94f14a7bc077-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-6570e88f-f3e7-41d5-98c4-94f14a7bc077-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:01 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "cinder-quobyte-6570e88f-f3e7-41d5-98c4-94f14a7bc077" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-quobyte-6570e88f-f3e7-41d5-98c4-94f14a7bc077" acquired by "delete_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:01 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa2931-b60b-4f41-96ee-26cad1ff2686]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:30:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077" returned: 0 in 0.377s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6570e88f-f3e7-41d5-98c4-94f14a7bc077" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-quobyte-6570e88f-f3e7-41d5-98c4-94f14a7bc077" released by "delete_volume" :: held 0.588s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Created reservations ['ae905127-59b7-47a0-a964-332f23453f95', '90d7a43d-e76b-4c4c-9d4e-5280e3322219', 'c6a12e7f-2e9b-41ab-86da-5879e9099816', '6318f44a-5057-4f93-ae88-119fd8b062c2'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.118s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:02 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:02 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Deleted volume successfully.
Sep 03 08:30:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b756eb27-23ae-4bf2-acaa-d459ad517564 tempest-VolumesTestJSON-1656337256 None] Lock "cinder-6570e88f-f3e7-41d5-98c4-94f14a7bc077-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-218fc785-abbc-4710-a9b8-502d1538a06a tempest-BackendsCapabilitiesAdminTestsJSON-1792115357 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9363098144531, 'free_capacity_gb': 924.9363098144531, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82397) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 03 08:30:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e04d6505-2a6e-4edd-8c21-f7a4ab9623d8 tempest-BackendsCapabilitiesAdminTestsJSON-1792115357 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9363098144531, 'free_capacity_gb': 924.9363098144531, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82397) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 03 08:30:12 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-32affc2c-35ce-4252-8896-8e16de8dbedb tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-32affc2c-35ce-4252-8896-8e16de8dbedb tempest-GroupsTest-385319233 None] Group tempest-Group1-1662401630: creating
Sep 03 08:30:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-32affc2c-35ce-4252-8896-8e16de8dbedb tempest-GroupsTest-385319233 None] Group tempest-Group1-1662401630: created successfully
Sep 03 08:30:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-32affc2c-35ce-4252-8896-8e16de8dbedb tempest-GroupsTest-385319233 None] Create group completed successfully.
Sep 03 08:30:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3d67d7d1-d217-48ed-b26d-020ad913d9c9 tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3d67d7d1-d217-48ed-b26d-020ad913d9c9 tempest-GroupsTest-385319233 None] Group tempest-Group2-1179526246: creating
Sep 03 08:30:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3d67d7d1-d217-48ed-b26d-020ad913d9c9 tempest-GroupsTest-385319233 None] Group tempest-Group2-1179526246: created successfully
Sep 03 08:30:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3d67d7d1-d217-48ed-b26d-020ad913d9c9 tempest-GroupsTest-385319233 None] Create group completed successfully.
Sep 03 08:30:15 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Flow 'volume_create_manager' (c6a641ba-3347-477f-9c33-e31cbf0f5980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb41d560-5913-490c-897e-82b7e399fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb41d560-5913-490c-897e-82b7e399fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474728916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dbc27de5-be14-4ec2-b4a2-d86688892b89,host='devstack@QuobyteHD#QuobyteHD',id=70a44780-21a6-4bf3-802f-8e527f218dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46910db8a484bff9d42a031c7465cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:15Z,use_quota=True,user_id='51291b62a4be418f8487fe729e551f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ce605fb-aeee-4655-a1a9-6e646ef43f16),volume_type_id=9ce605fb-aeee-4655-a1a9-6e646ef43f16)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a878ad-8bf8-4346-81f2-b94775cc0ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a878ad-8bf8-4346-81f2-b94775cc0ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5855ad0c-8192-4ecc-bf0b-5e6e8521bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5855ad0c-8192-4ecc-bf0b-5e6e8521bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a44780-21a6-4bf3-802f-8e527f218dcb', 'volume_name': 'volume-70a44780-21a6-4bf3-802f-8e527f218dcb', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d4363d-3abe-40bc-b214-2054298fe92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d4363d-3abe-40bc-b214-2054298fe92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4224e-8917-4c79-adec-952e73781430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:15 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Volume 70a44780-21a6-4bf3-802f-8e527f218dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a44780-21a6-4bf3-802f-8e527f218dcb', 'volume_size': 1}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dbc27de5-be14-4ec2-b4a2-d86688892b89,created_at=2025-09-03T06:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1474728916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dbc27de5-be14-4ec2-b4a2-d86688892b89,host='devstack@QuobyteHD#QuobyteHD',id=70a44780-21a6-4bf3-802f-8e527f218dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46910db8a484bff9d42a031c7465cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:15Z,use_quota=True,user_id='51291b62a4be418f8487fe729e551f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ce605fb-aeee-4655-a1a9-6e646ef43f16),volume_type_id=9ce605fb-aeee-4655-a1a9-6e646ef43f16)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Creating volume 70a44780-21a6-4bf3-802f-8e527f218dcb {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:30:15 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:15 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=98, name=volume-70a44780-21a6-4bf3-802f-8e527f218dcb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb 1073741824" returned: 0 in 0.326s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.487s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4224e-8917-4c79-adec-952e73781430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a44780-21a6-4bf3-802f-8e527f218dcb', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86aa739-ccd6-4b85-a460-dd22e11d588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:15 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Volume volume-70a44780-21a6-4bf3-802f-8e527f218dcb (70a44780-21a6-4bf3-802f-8e527f218dcb): created successfully
Sep 03 08:30:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86aa739-ccd6-4b85-a460-dd22e11d588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Flow 'volume_create_manager' (c6a641ba-3347-477f-9c33-e31cbf0f5980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:16 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a8d19b51-4e79-4727-b9dd-60672c134a44 tempest-GroupsTest-385319233 None] Created volume successfully.
Sep 03 08:30:16 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Acquiring lock "cinder-quobyte-70a44780-21a6-4bf3-802f-8e527f218dcb" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Lock "cinder-quobyte-70a44780-21a6-4bf3-802f-8e527f218dcb" acquired by "delete_volume" :: waited 0.048s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:16 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[76daca23-e1ca-4dbd-bdaf-8707cc489916]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:30:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb" returned: 0 in 0.381s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-70a44780-21a6-4bf3-802f-8e527f218dcb" returned: 0 in 0.106s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Lock "cinder-quobyte-70a44780-21a6-4bf3-802f-8e527f218dcb" released by "delete_volume" :: held 0.623s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:17 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Created reservations ['cfd68e2b-459a-48af-82ed-8e9b8e296bc1'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:17 devstack cinder-volume[82397]: WARNING cinder.quota [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1202011413 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1202011413, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:30:17 devstack cinder-volume[82397]: WARNING cinder.quota [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1202011413 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1202011413, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:30:17 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Created reservations ['c3cdebf2-0f2d-4c0f-a4f6-89a5436f7733', '1a3f5129-e916-4f46-9426-da7408a762aa', '52b386cb-8578-4a8f-8fc5-24a37a7e6569', 'f7b5dfcb-d8f4-4098-81cb-8d7fa2dae075'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.099s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:18 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:18 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-969730af-33da-4044-a9b6-1f6d6f5887de tempest-GroupsTest-385319233 None] Delete group completed successfully.
Sep 03 08:30:19 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Created reservations ['a779ec0f-abd3-418c-bc33-d980b8238104'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:19 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:19 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-dcf9b9ce-baf5-4c33-b324-4e2a93431afc tempest-GroupsTest-385319233 None] Delete group completed successfully.
Sep 03 08:30:20 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e2212b9f-d34f-47bb-b8ac-cb9c145674d0 tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e2212b9f-d34f-47bb-b8ac-cb9c145674d0 tempest-GroupsTest-385319233 None] Group tempest-GroupsTest-Group-663460738: creating
Sep 03 08:30:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e2212b9f-d34f-47bb-b8ac-cb9c145674d0 tempest-GroupsTest-385319233 None] Group tempest-GroupsTest-Group-663460738: created successfully
Sep 03 08:30:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e2212b9f-d34f-47bb-b8ac-cb9c145674d0 tempest-GroupsTest-385319233 None] Create group completed successfully.
Sep 03 08:30:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Flow 'volume_create_manager' (7cac68ce-a2da-40e4-958b-884f99c0a1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068c85de-8210-4c34-9837-0b8f0dceb3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068c85de-8210-4c34-9837-0b8f0dceb3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12470026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a23474bc-d03a-4c0a-b3cf-3897e932819c,host='devstack@QuobyteHD#QuobyteHD',id=03f387a7-ebc6-4880-b732-9f46e34ff57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46910db8a484bff9d42a031c7465cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:22Z,use_quota=True,user_id='51291b62a4be418f8487fe729e551f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e1b5be-d58a-42dc-a718-0abc6c09ab19),volume_type_id=d8e1b5be-d58a-42dc-a718-0abc6c09ab19)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87665bfa-5fbf-4054-87a4-4024960f5f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87665bfa-5fbf-4054-87a4-4024960f5f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105cb891-62d4-47de-8fa2-6ff2b9c10e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105cb891-62d4-47de-8fa2-6ff2b9c10e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f387a7-ebc6-4880-b732-9f46e34ff57f', 'volume_name': 'volume-03f387a7-ebc6-4880-b732-9f46e34ff57f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2967ebe6-00e8-4718-966a-7d01ae54d3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2967ebe6-00e8-4718-966a-7d01ae54d3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a20d8-e17d-4382-8470-09d9234806c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Volume 03f387a7-ebc6-4880-b732-9f46e34ff57f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f387a7-ebc6-4880-b732-9f46e34ff57f', 'volume_size': 1}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a23474bc-d03a-4c0a-b3cf-3897e932819c,created_at=2025-09-03T06:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12470026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a23474bc-d03a-4c0a-b3cf-3897e932819c,host='devstack@QuobyteHD#QuobyteHD',id=03f387a7-ebc6-4880-b732-9f46e34ff57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46910db8a484bff9d42a031c7465cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:22Z,use_quota=True,user_id='51291b62a4be418f8487fe729e551f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e1b5be-d58a-42dc-a718-0abc6c09ab19),volume_type_id=d8e1b5be-d58a-42dc-a718-0abc6c09ab19)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Creating volume 03f387a7-ebc6-4880-b732-9f46e34ff57f {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:30:22 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:22 devstack quobyte-client[82407]: System call of process 96337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:30:22 devstack quobyte-client[82407]: System call of process 96337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:30:22 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=99, name=volume-03f387a7-ebc6-4880-b732-9f46e34ff57f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f 1073741824" returned: 0 in 0.303s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] <== create_volume: return (440ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.451s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a20d8-e17d-4382-8470-09d9234806c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f387a7-ebc6-4880-b732-9f46e34ff57f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14375ac9-4ff8-43b3-a59f-6ed25e44ec4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Volume volume-03f387a7-ebc6-4880-b732-9f46e34ff57f (03f387a7-ebc6-4880-b732-9f46e34ff57f): created successfully
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14375ac9-4ff8-43b3-a59f-6ed25e44ec4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Flow 'volume_create_manager' (7cac68ce-a2da-40e4-958b-884f99c0a1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:23 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2aa067f1-8279-4c80-9f27-ff54b4ebf8e4 tempest-GroupsTest-385319233 None] Created volume successfully.
Sep 03 08:30:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Flow 'volume_create_manager' (fb487999-2fb2-429f-a4a7-aefe4c8f000e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce8405f-de9a-4c6e-b050-8e78ddee8412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce8405f-de9a-4c6e-b050-8e78ddee8412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2044807795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a23474bc-d03a-4c0a-b3cf-3897e932819c,host='devstack@QuobyteHD#QuobyteHD',id=afc9fe40-7206-4d03-8891-2119e822afc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46910db8a484bff9d42a031c7465cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:24Z,use_quota=True,user_id='51291b62a4be418f8487fe729e551f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e1b5be-d58a-42dc-a718-0abc6c09ab19),volume_type_id=d8e1b5be-d58a-42dc-a718-0abc6c09ab19)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849b1eaf-19ab-4f4f-a2c6-7ef5175d2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849b1eaf-19ab-4f4f-a2c6-7ef5175d2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817bff7b-8102-42e4-a48b-bfec757a5d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817bff7b-8102-42e4-a48b-bfec757a5d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc9fe40-7206-4d03-8891-2119e822afc4', 'volume_name': 'volume-afc9fe40-7206-4d03-8891-2119e822afc4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf85727-d97f-46e8-b16d-7f708bf41185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf85727-d97f-46e8-b16d-7f708bf41185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a5941a-e59c-46f8-856b-f07b1a7e73a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Volume afc9fe40-7206-4d03-8891-2119e822afc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc9fe40-7206-4d03-8891-2119e822afc4', 'volume_size': 1}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a23474bc-d03a-4c0a-b3cf-3897e932819c,created_at=2025-09-03T06:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2044807795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a23474bc-d03a-4c0a-b3cf-3897e932819c,host='devstack@QuobyteHD#QuobyteHD',id=afc9fe40-7206-4d03-8891-2119e822afc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46910db8a484bff9d42a031c7465cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:24Z,use_quota=True,user_id='51291b62a4be418f8487fe729e551f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e1b5be-d58a-42dc-a718-0abc6c09ab19),volume_type_id=d8e1b5be-d58a-42dc-a718-0abc6c09ab19)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Creating volume afc9fe40-7206-4d03-8891-2119e822afc4 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:30:23 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:30:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:24 devstack quobyte-client[82407]: System call of process 96342 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:30:24 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=100, name=volume-afc9fe40-7206-4d03-8891-2119e822afc4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4 1073741824" returned: 0 in 0.331s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4" returned: 0 in 0.078s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] <== create_volume: return (469ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.479s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a5941a-e59c-46f8-856b-f07b1a7e73a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc9fe40-7206-4d03-8891-2119e822afc4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6838ce23-1430-4f0b-a5cc-67d245c97a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Volume volume-afc9fe40-7206-4d03-8891-2119e822afc4 (afc9fe40-7206-4d03-8891-2119e822afc4): created successfully
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6838ce23-1430-4f0b-a5cc-67d245c97a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Flow 'volume_create_manager' (fb487999-2fb2-429f-a4a7-aefe4c8f000e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f391aa17-0658-4b8f-a8c7-6ecd174f0d89 tempest-GroupsTest-385319233 None] Created volume successfully.
Sep 03 08:30:24 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-956ef679-9646-4051-be80-f948583856c2 tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-956ef679-9646-4051-be80-f948583856c2 tempest-GroupsTest-385319233 None] Update group completed successfully.
Sep 03 08:30:26 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4d84d55a-b600-4ba8-95b5-a7bb9cd1f29a tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4d84d55a-b600-4ba8-95b5-a7bb9cd1f29a tempest-GroupsTest-385319233 None] Update group completed successfully.
Sep 03 08:30:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Acquiring lock "cinder-quobyte-03f387a7-ebc6-4880-b732-9f46e34ff57f" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Lock "cinder-quobyte-03f387a7-ebc6-4880-b732-9f46e34ff57f" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:27 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe84a19-1c37-4e3a-8dae-2bddf4890513]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:30:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f" returned: 0 in 0.420s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-03f387a7-ebc6-4880-b732-9f46e34ff57f" returned: 0 in 0.108s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Lock "cinder-quobyte-03f387a7-ebc6-4880-b732-9f46e34ff57f" released by "delete_volume" :: held 0.704s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Acquiring lock "cinder-quobyte-afc9fe40-7206-4d03-8891-2119e822afc4" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Lock "cinder-quobyte-afc9fe40-7206-4d03-8891-2119e822afc4" acquired by "delete_volume" :: waited 0.027s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27fe7b7-9cde-4311-b194-d9327814ab39]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:30:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4" returned: 0 in 0.456s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-afc9fe40-7206-4d03-8891-2119e822afc4" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Lock "cinder-quobyte-afc9fe40-7206-4d03-8891-2119e822afc4" released by "delete_volume" :: held 0.693s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=53,cinder:INSERT=19,cinder:UPDATE=91,cinder:DELETE=9 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Created reservations ['b2f8078d-fe4f-4607-9324-2491aa26067c'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:29 devstack cinder-volume[82397]: WARNING cinder.quota [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-273428013 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-273428013, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:30:29 devstack cinder-volume[82397]: WARNING cinder.quota [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-273428013 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-273428013, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Created reservations ['beeef343-adb6-4f42-adc2-893953a01649', '6d4123f4-b357-46a5-8999-5c107ee853f0', 'fb4a7168-2ce7-4dad-accc-bd907b8a79de', '7f6b22ce-3428-4454-bc6b-f4c9ccd78f2b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:29 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Created reservations ['0b2fe419-62a8-49ea-b0c5-bbede034542f', '649a4e4a-f5e6-46b3-8b10-252b9bbb25b9', '2e4f21cc-8be7-4ce3-86fb-d5265c173d64', '1d58bc60-2448-4c27-a2fb-87d07010d12b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.108s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:30 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:30 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d799db4d-1286-42b3-b7ae-95e1c672ad80 tempest-GroupsTest-385319233 None] Delete group completed successfully.
Sep 03 08:30:40 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:INSERT=7,cinder:UPDATE=16 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:30:40 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=106,cinder:SELECT=98,cinder:INSERT=17,cinder:DELETE=5 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:30:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Flow 'volume_create_manager' (3936ae44-4b6a-4e2b-9bdb-da79b2899b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fe955d-aae7-42e5-9d8e-28748f69a6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fe955d-aae7-42e5-9d8e-28748f69a6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-811302829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67402720-8c8b-4c84-9da4-caa2f88553fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb7d37382d74a71a3e3b71ab91e08bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:48Z,use_quota=True,user_id='3435434fe04b4894ba06acf65586229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1d0a4c-4737-47db-99d0-fe0060a3bd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1d0a4c-4737-47db-99d0-fe0060a3bd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beeab20-e559-45f1-b691-f8c324f5dfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beeab20-e559-45f1-b691-f8c324f5dfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67402720-8c8b-4c84-9da4-caa2f88553fe', 'volume_name': 'volume-67402720-8c8b-4c84-9da4-caa2f88553fe', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96acaa49-e547-4e23-a11d-05b968105b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96acaa49-e547-4e23-a11d-05b968105b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c975f11-9126-4892-8391-17cce71a6726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:47 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume 67402720-8c8b-4c84-9da4-caa2f88553fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67402720-8c8b-4c84-9da4-caa2f88553fe', 'volume_size': 1}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-811302829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67402720-8c8b-4c84-9da4-caa2f88553fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb7d37382d74a71a3e3b71ab91e08bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:48Z,use_quota=True,user_id='3435434fe04b4894ba06acf65586229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Creating volume 67402720-8c8b-4c84-9da4-caa2f88553fe {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:30:47 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:30:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:48 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=101, name=volume-67402720-8c8b-4c84-9da4-caa2f88553fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe 1073741824" returned: 0 in 0.306s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] <== create_volume: return (449ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.460s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c975f11-9126-4892-8391-17cce71a6726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67402720-8c8b-4c84-9da4-caa2f88553fe', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cf510f-3f78-4980-a8a7-1dacbbf76d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:48 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume volume-67402720-8c8b-4c84-9da4-caa2f88553fe (67402720-8c8b-4c84-9da4-caa2f88553fe): created successfully
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cf510f-3f78-4980-a8a7-1dacbbf76d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Flow 'volume_create_manager' (3936ae44-4b6a-4e2b-9bdb-da79b2899b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d0c08285-701b-458f-be17-3223b6f70a3f tempest-VolumeQuotasAdminTestJSON-1363876110 None] Created volume successfully.
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.094s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Acquiring lock "cinder-67402720-8c8b-4c84-9da4-caa2f88553fe-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "cinder-67402720-8c8b-4c84-9da4-caa2f88553fe-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Acquiring lock "cinder-quobyte-67402720-8c8b-4c84-9da4-caa2f88553fe" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "cinder-quobyte-67402720-8c8b-4c84-9da4-caa2f88553fe" acquired by "delete_volume" :: waited 0.017s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7964f4-ff67-4637-87cc-b4fbcef72a11]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe" returned: 0 in 0.452s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-67402720-8c8b-4c84-9da4-caa2f88553fe" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "cinder-quobyte-67402720-8c8b-4c84-9da4-caa2f88553fe" released by "delete_volume" :: held 0.699s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Created reservations ['ed786719-9be3-4d23-b10b-13a2ec6f733d', '9d90acd3-f3e7-4a79-9841-bc18f09c848d', '2331c344-b7ec-4d61-8ca9-9fef67e3f6b9', '0116efde-0f3b-4e1a-8776-c3fad9a8272c'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.091s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:51 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Deleted volume successfully.
Sep 03 08:30:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-182dd8c4-16af-410c-9a5e-c82792f3dfbb tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "cinder-67402720-8c8b-4c84-9da4-caa2f88553fe-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:52 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:30:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Flow 'volume_create_manager' (f5d10185-7d46-4dde-869a-a5d3cb7fcfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9909dfc1-7e4f-47b4-aaf0-f5fc242fb775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9909dfc1-7e4f-47b4-aaf0-f5fc242fb775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-760237336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83351a68-8b19-43c9-bb06-9bb1983d9d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb7d37382d74a71a3e3b71ab91e08bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:53Z,use_quota=True,user_id='3435434fe04b4894ba06acf65586229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6495310c-12ef-4b46-9e7d-613cd677d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6495310c-12ef-4b46-9e7d-613cd677d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dd9bac-284b-4115-b21e-0218bd2c30a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dd9bac-284b-4115-b21e-0218bd2c30a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83351a68-8b19-43c9-bb06-9bb1983d9d64', 'volume_name': 'volume-83351a68-8b19-43c9-bb06-9bb1983d9d64', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7e320c-06dc-40d8-90ed-9d3fddeb73eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7e320c-06dc-40d8-90ed-9d3fddeb73eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d561ad-cf0d-49b5-8ee8-ac6923bd42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:53 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume 83351a68-8b19-43c9-bb06-9bb1983d9d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83351a68-8b19-43c9-bb06-9bb1983d9d64', 'volume_size': 1}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-760237336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83351a68-8b19-43c9-bb06-9bb1983d9d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb7d37382d74a71a3e3b71ab91e08bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:30:53Z,use_quota=True,user_id='3435434fe04b4894ba06acf65586229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Creating volume 83351a68-8b19-43c9-bb06-9bb1983d9d64 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:30:53 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:53 devstack quobyte-client[82407]: System call of process 96406 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:30:53 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=102, name=volume-83351a68-8b19-43c9-bb06-9bb1983d9d64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64 1073741824" returned: 0 in 0.399s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64" returned: 0 in 0.110s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] <== create_volume: return (567ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.579s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d561ad-cf0d-49b5-8ee8-ac6923bd42bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83351a68-8b19-43c9-bb06-9bb1983d9d64', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2b548-ab92-4d8d-a041-d8f261eabb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:30:53 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Volume volume-83351a68-8b19-43c9-bb06-9bb1983d9d64 (83351a68-8b19-43c9-bb06-9bb1983d9d64): created successfully
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2b548-ab92-4d8d-a041-d8f261eabb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:30:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Flow 'volume_create_manager' (f5d10185-7d46-4dde-869a-a5d3cb7fcfe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:30:53 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-bdc8873d-e592-4d7b-8dea-211a0110c7b9 tempest-VolumeQuotasAdminTestJSON-1363876110 None] Created volume successfully.
Sep 03 08:30:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-21bb1728-9c79-4c28-947e-65cdd9ad942c tempest-VolumeQuotasAdminTestJSON-477160412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:55 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-21bb1728-9c79-4c28-947e-65cdd9ad942c tempest-VolumeQuotasAdminTestJSON-477160412 None] Transfer volume completed successfully.
Sep 03 08:30:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Acquiring lock "cinder-83351a68-8b19-43c9-bb06-9bb1983d9d64-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Lock "cinder-83351a68-8b19-43c9-bb06-9bb1983d9d64-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:30:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Acquiring lock "cinder-quobyte-83351a68-8b19-43c9-bb06-9bb1983d9d64" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:30:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Lock "cinder-quobyte-83351a68-8b19-43c9-bb06-9bb1983d9d64" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:30:56 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73086d-a4d6-4317-ac4a-5d121775438f]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:30:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64" returned: 0 in 0.385s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-83351a68-8b19-43c9-bb06-9bb1983d9d64" returned: 0 in 0.163s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Lock "cinder-quobyte-83351a68-8b19-43c9-bb06-9bb1983d9d64" released by "delete_volume" :: held 0.662s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Created reservations ['6e64378c-355e-4d1c-adf6-34d907c16199', 'b41c4583-56af-4cb6-9613-6c0f70d3318b', 'af2bd7cc-b4a9-45fb-9a06-d3cb87854f99', '6db47a8e-386c-4b8b-bc20-38078261a869'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.099s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:30:57 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:30:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Deleted volume successfully.
Sep 03 08:30:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13c3567a-efcc-4418-b229-d0ad6d111e23 tempest-VolumeQuotasAdminTestJSON-246723169 None] Lock "cinder-83351a68-8b19-43c9-bb06-9bb1983d9d64-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:31:06 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Flow 'volume_create_manager' (c799e782-682c-41ff-be1b-c123a986df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a1b2f5-ab9b-4967-81c9-923f939b94c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a1b2f5-ab9b-4967-81c9-923f939b94c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1160483102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3515865-4c62-4702-bd42-dc4450c34a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e723eca863d49cb895f42fb9f91cadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:31:06Z,use_quota=True,user_id='222643c57c914c879a520a4dfa2b600c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46206e8b-665f-4b80-b6c6-6ac6d4b7a783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46206e8b-665f-4b80-b6c6-6ac6d4b7a783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4779938c-fd4a-4d56-b278-721bf92c4d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4779938c-fd4a-4d56-b278-721bf92c4d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3515865-4c62-4702-bd42-dc4450c34a44', 'volume_name': 'volume-d3515865-4c62-4702-bd42-dc4450c34a44', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4438c906-34ea-4dc5-a0f4-2b3896fc07f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4438c906-34ea-4dc5-a0f4-2b3896fc07f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248672cf-4348-42e2-9019-333e1a180e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:31:06 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Volume d3515865-4c62-4702-bd42-dc4450c34a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3515865-4c62-4702-bd42-dc4450c34a44', 'volume_size': 1}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1160483102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3515865-4c62-4702-bd42-dc4450c34a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e723eca863d49cb895f42fb9f91cadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:31:06Z,use_quota=True,user_id='222643c57c914c879a520a4dfa2b600c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Creating volume d3515865-4c62-4702-bd42-dc4450c34a44 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:31:06 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:31:06 devstack quobyte-client[82407]: System call of process 96419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:31:06 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=103, name=volume-d3515865-4c62-4702-bd42-dc4450c34a44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44 1073741824" returned: 0 in 0.372s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] <== create_volume: return (512ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:31:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.523s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:31:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248672cf-4348-42e2-9019-333e1a180e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3515865-4c62-4702-bd42-dc4450c34a44', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:31:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bd7072-f44d-4c8f-aa9d-1ce37fbb8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:31:07 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Volume volume-d3515865-4c62-4702-bd42-dc4450c34a44 (d3515865-4c62-4702-bd42-dc4450c34a44): created successfully
Sep 03 08:31:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8bd7072-f44d-4c8f-aa9d-1ce37fbb8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:31:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Flow 'volume_create_manager' (c799e782-682c-41ff-be1b-c123a986df8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:31:07 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-0a581175-c479-431a-a202-6cd33f526878 tempest-VolumesServicesTestJSON-1246010622 None] Created volume successfully.
Sep 03 08:31:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Acquiring lock "cinder-d3515865-4c62-4702-bd42-dc4450c34a44-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:31:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Lock "cinder-d3515865-4c62-4702-bd42-dc4450c34a44-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:31:08 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:31:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Acquiring lock "cinder-quobyte-d3515865-4c62-4702-bd42-dc4450c34a44" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:31:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Lock "cinder-quobyte-d3515865-4c62-4702-bd42-dc4450c34a44" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:31:08 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3853c-af33-4a7b-b6dd-116143017591]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:31:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44" returned: 0 in 0.397s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d3515865-4c62-4702-bd42-dc4450c34a44" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Lock "cinder-quobyte-d3515865-4c62-4702-bd42-dc4450c34a44" released by "delete_volume" :: held 0.639s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Created reservations ['2a899161-9dde-4e6d-adf6-f1f7195fc1a7', '3a7446ec-3e6d-4042-b98c-4642b9b382c0', '7c012a19-ad46-404e-b40c-73fc68543542', 'd4beac45-d545-4393-a8ca-e183b1f47ded'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:31:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:31:10 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:31:10 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Deleted volume successfully.
Sep 03 08:31:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9dbb6857-e24c-4e5c-b842-5b99ae30528d tempest-VolumesServicesTestJSON-1246010622 None] Lock "cinder-d3515865-4c62-4702-bd42-dc4450c34a44-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:31:19 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:INSERT=10 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:31:20 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=19,cinder:UPDATE=40,cinder:DELETE=6,cinder:INSERT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.110s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:31:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:10 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:10 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (1c46dcb4-37dd-4728-905a-21a2081487a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd55a01-9666-47b6-9725-ed05237f2478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd55a01-9666-47b6-9725-ed05237f2478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1619298186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681b7b25-61d8-4897-a161-ffc3d26c04f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:11Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c055572-4ec0-4039-b067-2d960ed241e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c055572-4ec0-4039-b067-2d960ed241e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c291003-84bd-4d89-860d-09d6a21a0bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c291003-84bd-4d89-860d-09d6a21a0bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681b7b25-61d8-4897-a161-ffc3d26c04f3', 'volume_name': 'volume-681b7b25-61d8-4897-a161-ffc3d26c04f3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59985290-84a8-4d94-af59-66d9f1ef015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59985290-84a8-4d94-af59-66d9f1ef015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3388e5ad-bd11-4b8a-947d-e2832ea119fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:11 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Volume 681b7b25-61d8-4897-a161-ffc3d26c04f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681b7b25-61d8-4897-a161-ffc3d26c04f3', 'volume_size': 1}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1619298186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681b7b25-61d8-4897-a161-ffc3d26c04f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:11Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Creating volume 681b7b25-61d8-4897-a161-ffc3d26c04f3 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:32:11 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:11 devstack quobyte-client[82407]: System call of process 96572 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:32:11 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=104, name=volume-681b7b25-61d8-4897-a161-ffc3d26c04f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3 1073741824" returned: 0 in 0.446s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3" returned: 0 in 0.134s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] <== create_volume: return (669ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:32:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3388e5ad-bd11-4b8a-947d-e2832ea119fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681b7b25-61d8-4897-a161-ffc3d26c04f3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be92ddb-2099-4570-9681-d8a40ffe1e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:12 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Volume volume-681b7b25-61d8-4897-a161-ffc3d26c04f3 (681b7b25-61d8-4897-a161-ffc3d26c04f3): created successfully
Sep 03 08:32:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be92ddb-2099-4570-9681-d8a40ffe1e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (1c46dcb4-37dd-4728-905a-21a2081487a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-36330cd3-775f-4c19-94bf-f5214baaef83 tempest-VolumesActionsTest-1826545137 None] Created volume successfully.
Sep 03 08:32:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e7b17cc7-6103-427b-993a-9098d696bb0c tempest-VolumesActionsTest-1826545137 None] Acquiring lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3" by "attach_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e7b17cc7-6103-427b-993a-9098d696bb0c tempest-VolumesActionsTest-1826545137 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3" acquired by "attach_volume" :: waited 0.028s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e7b17cc7-6103-427b-993a-9098d696bb0c tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e7b17cc7-6103-427b-993a-9098d696bb0c tempest-VolumesActionsTest-1826545137 None] Attaching volume 681b7b25-61d8-4897-a161-ffc3d26c04f3 to instance 32fd24c8-e508-4a74-aeec-f819bb916488 at mountpoint /dev/vdb on host None.
Sep 03 08:32:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e7b17cc7-6103-427b-993a-9098d696bb0c tempest-VolumesActionsTest-1826545137 None] Attach volume completed successfully.
Sep 03 08:32:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e7b17cc7-6103-427b-993a-9098d696bb0c tempest-VolumesActionsTest-1826545137 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3" released by "attach_volume" :: held 0.376s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Terminate volume connection completed successfully.
Sep 03 08:32:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-detach_volume" by "detach_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Detaching volume 681b7b25-61d8-4897-a161-ffc3d26c04f3 from instance 32fd24c8-e508-4a74-aeec-f819bb916488.
Sep 03 08:32:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:14 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Detach volume completed successfully.
Sep 03 08:32:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8a9c2aff-e2d4-4f4f-8534-06b135fd2bf0 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a10dbefd-85c9-4918-b847-ee5a1cc7745c tempest-VolumesActionsTest-1826545137 None] Acquiring lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-detach_volume" by "detach_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a10dbefd-85c9-4918-b847-ee5a1cc7745c tempest-VolumesActionsTest-1826545137 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:15 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a10dbefd-85c9-4918-b847-ee5a1cc7745c tempest-VolumesActionsTest-1826545137 None] Volume detach called, but volume not attached.
Sep 03 08:32:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a10dbefd-85c9-4918-b847-ee5a1cc7745c tempest-VolumesActionsTest-1826545137 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:16 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "cinder-quobyte-681b7b25-61d8-4897-a161-ffc3d26c04f3" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-quobyte-681b7b25-61d8-4897-a161-ffc3d26c04f3" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[039e5522-35fe-4109-964a-45475ee5ca71]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3" returned: 0 in 0.456s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-681b7b25-61d8-4897-a161-ffc3d26c04f3" returned: 0 in 0.109s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-quobyte-681b7b25-61d8-4897-a161-ffc3d26c04f3" released by "delete_volume" :: held 0.768s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Created reservations ['63e60e46-0390-47d4-8f45-c5899544fd1c', 'b402b31c-2c8e-460f-ab75-f67a51961e1a', 'c3da1224-ae9e-4c01-a57e-0519b90486cd', '5172be40-b7ba-405e-8cd3-a7506da3cf10'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.156s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:17 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Deleted volume successfully.
Sep 03 08:32:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b5802719-5448-4617-b860-5f19e5b99d65 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-681b7b25-61d8-4897-a161-ffc3d26c04f3-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (3d94a9da-994b-405f-94bf-0747f1e62494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfc0768-ed19-4419-8bde-e128a8ca06d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfc0768-ed19-4419-8bde-e128a8ca06d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141510217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497a5c6d-a69f-4f51-b165-c7887d2abed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:27Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7f0dee-32bc-4c46-8876-a8c5beb4c2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7f0dee-32bc-4c46-8876-a8c5beb4c2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d337625-c5ab-4f5b-a9cd-7ece3c1b5a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d337625-c5ab-4f5b-a9cd-7ece3c1b5a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497a5c6d-a69f-4f51-b165-c7887d2abed7', 'volume_name': 'volume-497a5c6d-a69f-4f51-b165-c7887d2abed7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f5642-224b-4cb3-b9ef-629754a45dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4f5642-224b-4cb3-b9ef-629754a45dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6014ad6a-1a44-4e9a-a74a-19312b45d3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:27 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Volume 497a5c6d-a69f-4f51-b165-c7887d2abed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497a5c6d-a69f-4f51-b165-c7887d2abed7', 'volume_size': 1}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2141510217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497a5c6d-a69f-4f51-b165-c7887d2abed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:27Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Creating volume 497a5c6d-a69f-4f51-b165-c7887d2abed7 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:32:27 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:27 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=105, name=volume-497a5c6d-a69f-4f51-b165-c7887d2abed7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7 1073741824" returned: 0 in 0.418s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] <== create_volume: return (630ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:32:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.643s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6014ad6a-1a44-4e9a-a74a-19312b45d3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497a5c6d-a69f-4f51-b165-c7887d2abed7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95698ab-3765-4b56-a3e3-a648aec75a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:28 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Volume volume-497a5c6d-a69f-4f51-b165-c7887d2abed7 (497a5c6d-a69f-4f51-b165-c7887d2abed7): created successfully
Sep 03 08:32:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95698ab-3765-4b56-a3e3-a648aec75a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (3d94a9da-994b-405f-94bf-0747f1e62494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:28 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f0552684-9891-4083-8bdb-51b922fb0b51 tempest-VolumesActionsTest-1826545137 None] Created volume successfully.
Sep 03 08:32:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-497a5c6d-a69f-4f51-b165-c7887d2abed7-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-497a5c6d-a69f-4f51-b165-c7887d2abed7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:29 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-quobyte-497a5c6d-a69f-4f51-b165-c7887d2abed7" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-497a5c6d-a69f-4f51-b165-c7887d2abed7" acquired by "delete_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:29 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5239376-15c3-4b86-990e-7e8bc88b4485]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:32:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7" returned: 0 in 0.397s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-497a5c6d-a69f-4f51-b165-c7887d2abed7" returned: 0 in 0.087s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-497a5c6d-a69f-4f51-b165-c7887d2abed7" released by "delete_volume" :: held 0.641s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Created reservations ['9b01e034-0001-4dd6-80b9-a11e5bb9c9bd', 'cc48086d-e748-41a6-8140-18c7edcf3aac', '892acfd6-aace-4eef-8226-f34870a0948a', 'ecff9496-5698-4b7c-b9e4-033823440932'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.115s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:31 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Deleted volume successfully.
Sep 03 08:32:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-717b46f0-5c83-45b4-83e9-41cb70b27ef9 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-497a5c6d-a69f-4f51-b165-c7887d2abed7-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (474d730b-e9ed-457f-9410-116a5d380c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84950053-58cc-415a-902d-f0506c158fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84950053-58cc-415a-902d-f0506c158fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1247229669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da47773-2aab-4f3b-ab58-13edd2959bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:32Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b682f2a6-294a-47c4-886d-7646b2fb0694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b682f2a6-294a-47c4-886d-7646b2fb0694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c05f6f9-e78a-4c3d-86ab-58117a17c89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c05f6f9-e78a-4c3d-86ab-58117a17c89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da47773-2aab-4f3b-ab58-13edd2959bec', 'volume_name': 'volume-6da47773-2aab-4f3b-ab58-13edd2959bec', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e11a9b-2ada-4fa8-80a7-230e7e12efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e11a9b-2ada-4fa8-80a7-230e7e12efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c422c7d1-1319-4bdf-88bd-ffaceeb10891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:32 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Volume 6da47773-2aab-4f3b-ab58-13edd2959bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da47773-2aab-4f3b-ab58-13edd2959bec', 'volume_size': 1}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1247229669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da47773-2aab-4f3b-ab58-13edd2959bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:32Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Creating volume 6da47773-2aab-4f3b-ab58-13edd2959bec {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:32:32 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:32 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=106, name=volume-6da47773-2aab-4f3b-ab58-13edd2959bec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec 1073741824" returned: 0 in 0.302s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec" returned: 0 in 0.083s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] <== create_volume: return (451ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.464s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c422c7d1-1319-4bdf-88bd-ffaceeb10891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da47773-2aab-4f3b-ab58-13edd2959bec', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d200e252-fbb8-486d-9c26-51080bbde25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:33 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Volume volume-6da47773-2aab-4f3b-ab58-13edd2959bec (6da47773-2aab-4f3b-ab58-13edd2959bec): created successfully
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d200e252-fbb8-486d-9c26-51080bbde25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (474d730b-e9ed-457f-9410-116a5d380c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c4f56d3a-810f-4ec8-857a-cea304011f37 tempest-VolumesActionsTest-1826545137 None] Created volume successfully.
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-6da47773-2aab-4f3b-ab58-13edd2959bec-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-6da47773-2aab-4f3b-ab58-13edd2959bec-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-quobyte-6da47773-2aab-4f3b-ab58-13edd2959bec" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-6da47773-2aab-4f3b-ab58-13edd2959bec" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14cf310-aa68-425a-9ed4-3f8c7dc901e0]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:32:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec" returned: 0 in 0.385s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6da47773-2aab-4f3b-ab58-13edd2959bec" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-6da47773-2aab-4f3b-ab58-13edd2959bec" released by "delete_volume" :: held 0.625s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Created reservations ['b9e1a31f-9bf9-46a6-9b9d-d8941428d03a', 'a0574fc3-a9be-457e-81a1-6c3b3bcfb05c', 'e89d0974-8f28-46db-a9ce-e7390e77e9e1', '5e100ad6-35bd-4235-8b12-70d16004eee7'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.101s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:34 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:35 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Deleted volume successfully.
Sep 03 08:32:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b21b8775-6b56-40e3-b6a0-a9f6aeab0532 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-6da47773-2aab-4f3b-ab58-13edd2959bec-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (f47f4689-0b96-4694-80a3-1c4774071879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade92a65-b9c6-4706-817f-d880ff59a121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade92a65-b9c6-4706-817f-d880ff59a121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719216344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b361ad3c-eddd-46fb-b76b-5d3ebdb76579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:36Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48463d0b-24be-45d0-ac4a-f2e978bd7e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48463d0b-24be-45d0-ac4a-f2e978bd7e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5501ac-148a-4e6b-a102-2b96909f43bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5501ac-148a-4e6b-a102-2b96909f43bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b361ad3c-eddd-46fb-b76b-5d3ebdb76579', 'volume_name': 'volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7f3025-7a58-4e81-a63a-62629d6803b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7f3025-7a58-4e81-a63a-62629d6803b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2161b4-c09f-4647-b5f0-5bcd3f2fa816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:36 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Volume b361ad3c-eddd-46fb-b76b-5d3ebdb76579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579', 'volume_size': 1}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719216344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b361ad3c-eddd-46fb-b76b-5d3ebdb76579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:36Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Creating volume b361ad3c-eddd-46fb-b76b-5d3ebdb76579 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:32:36 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:32:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:36 devstack quobyte-client[82407]: System call of process 96687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:32:36 devstack quobyte-client[82407]: System call of process 96687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:32:36 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=107, name=volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:32:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579 1073741824" returned: 0 in 0.324s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] <== create_volume: return (470ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:32:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2161b4-c09f-4647-b5f0-5bcd3f2fa816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52226e6b-1d46-42ba-a2e3-3be59a31a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:38 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Volume volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579 (b361ad3c-eddd-46fb-b76b-5d3ebdb76579): created successfully
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52226e6b-1d46-42ba-a2e3-3be59a31a148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (f47f4689-0b96-4694-80a3-1c4774071879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:38 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-65d5f8c8-e7d1-407f-9acb-3577d5eb40f5 tempest-VolumesActionsTest-1826545137 None] Created volume successfully.
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-b361ad3c-eddd-46fb-b76b-5d3ebdb76579-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-b361ad3c-eddd-46fb-b76b-5d3ebdb76579-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:38 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-quobyte-b361ad3c-eddd-46fb-b76b-5d3ebdb76579" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-b361ad3c-eddd-46fb-b76b-5d3ebdb76579" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:39 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12b1ba-60fa-453e-bf99-b20b744620dc]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:32:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579" returned: 0 in 0.435s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b361ad3c-eddd-46fb-b76b-5d3ebdb76579" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-b361ad3c-eddd-46fb-b76b-5d3ebdb76579" released by "delete_volume" :: held 0.683s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:39 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Created reservations ['614b4a9d-3ae2-472d-a401-ca06cadde6c3', 'ac600927-0783-4da1-bdf7-e24f6782f6cb', '943520f2-6bc9-4fcf-8003-9d3bd470f451', '80a56560-95e7-4a25-9689-f1f840d621d3'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.078s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:40 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Deleted volume successfully.
Sep 03 08:32:40 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bc96b9f8-85b9-4d1f-b15d-cfe4af2d2bb2 tempest-VolumesActionsTest-2070992149 None] Lock "cinder-b361ad3c-eddd-46fb-b76b-5d3ebdb76579-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:41 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (ade46d05-0bbe-49fa-868b-8abf53fd47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77e93c4-e3e0-425d-9c9a-daaba839272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77e93c4-e3e0-425d-9c9a-daaba839272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-118540527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466c8ee7-37c8-4b3e-83e3-785d946b8198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:41Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844d0230-e467-4599-9184-2e47a52f299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844d0230-e467-4599-9184-2e47a52f299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38affa09-08b4-4ba9-8224-b6261fa53055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38affa09-08b4-4ba9-8224-b6261fa53055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466c8ee7-37c8-4b3e-83e3-785d946b8198', 'volume_name': 'volume-466c8ee7-37c8-4b3e-83e3-785d946b8198', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060ec077-6836-40fd-905e-77a26bd684d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060ec077-6836-40fd-905e-77a26bd684d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85408ec9-05f0-4cdb-83f5-66dbcf6c26ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:41 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Volume 466c8ee7-37c8-4b3e-83e3-785d946b8198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466c8ee7-37c8-4b3e-83e3-785d946b8198', 'volume_size': 1}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-118540527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466c8ee7-37c8-4b3e-83e3-785d946b8198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:41Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Creating volume 466c8ee7-37c8-4b3e-83e3-785d946b8198 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:32:41 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:32:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:41 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=108, name=volume-466c8ee7-37c8-4b3e-83e3-785d946b8198, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198 1073741824" returned: 0 in 0.325s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] <== create_volume: return (483ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.496s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85408ec9-05f0-4cdb-83f5-66dbcf6c26ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466c8ee7-37c8-4b3e-83e3-785d946b8198', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14561f8e-d8f0-4659-b55b-60c2a96b9c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:42 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Volume volume-466c8ee7-37c8-4b3e-83e3-785d946b8198 (466c8ee7-37c8-4b3e-83e3-785d946b8198): created successfully
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14561f8e-d8f0-4659-b55b-60c2a96b9c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (ade46d05-0bbe-49fa-868b-8abf53fd47ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:42 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-274824fb-d6cc-454c-aed4-1ba72d398435 tempest-VolumesActionsTest-1826545137 None] Created volume successfully.
Sep 03 08:32:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-466c8ee7-37c8-4b3e-83e3-785d946b8198-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Lock "cinder-466c8ee7-37c8-4b3e-83e3-785d946b8198-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:44 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Acquiring lock "cinder-quobyte-466c8ee7-37c8-4b3e-83e3-785d946b8198" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-466c8ee7-37c8-4b3e-83e3-785d946b8198" acquired by "delete_volume" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7225fc4-bd4f-49e8-b23d-eb246d76569d]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198" returned: 0 in 0.432s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-466c8ee7-37c8-4b3e-83e3-785d946b8198" returned: 0 in 0.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Lock "cinder-quobyte-466c8ee7-37c8-4b3e-83e3-785d946b8198" released by "delete_volume" :: held 0.699s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:44 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Created reservations ['696a7251-acbc-40b2-ad6e-17e5d92932be', '5bc65f47-3270-45be-ad8b-6c60fb8c023c', '0ad94da0-7d80-4fc6-88ea-a3bf93a07ef8', 'b364d303-f1dd-46ee-a174-97093c876c38'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.097s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Deleted volume successfully.
Sep 03 08:32:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-70b54340-bb1f-4247-b610-2319ffdf58df tempest-VolumesActionsTest-2070992149 None] Lock "cinder-466c8ee7-37c8-4b3e-83e3-785d946b8198-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (2d052ac4-6257-497b-bd16-d7368b0163b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5089646c-1d01-47d1-a4ea-d02b8d7fbbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5089646c-1d01-47d1-a4ea-d02b8d7fbbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-98126112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6071dff6-f7bf-4905-ac29-5cf6944e5844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:47Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cb5c04-affc-4ed9-80ac-5c7e77390c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cb5c04-affc-4ed9-80ac-5c7e77390c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfb5dd3-c622-4138-a91a-32d1d2f12a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfb5dd3-c622-4138-a91a-32d1d2f12a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6071dff6-f7bf-4905-ac29-5cf6944e5844', 'volume_name': 'volume-6071dff6-f7bf-4905-ac29-5cf6944e5844', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eca140d-5367-4e3a-93ae-c54c6680f24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eca140d-5367-4e3a-93ae-c54c6680f24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c47e017-f4c7-4da2-80fd-c78f12aa21ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:46 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Volume 6071dff6-f7bf-4905-ac29-5cf6944e5844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6071dff6-f7bf-4905-ac29-5cf6944e5844', 'volume_size': 1}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-98126112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6071dff6-f7bf-4905-ac29-5cf6944e5844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49af3ff9c6254d2a86b3e883810ef98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:32:47Z,use_quota=True,user_id='55ff0fe8d3c64249bde4c990c4e8a369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Creating volume 6071dff6-f7bf-4905-ac29-5cf6944e5844 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:32:46 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:32:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:47 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=109, name=volume-6071dff6-f7bf-4905-ac29-5cf6944e5844, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844 1073741824" returned: 0 in 0.315s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844" returned: 0 in 0.081s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] <== create_volume: return (464ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.478s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c47e017-f4c7-4da2-80fd-c78f12aa21ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6071dff6-f7bf-4905-ac29-5cf6944e5844', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee6091f-e58e-45ec-aef4-c11aefa2e5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:32:47 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Volume volume-6071dff6-f7bf-4905-ac29-5cf6944e5844 (6071dff6-f7bf-4905-ac29-5cf6944e5844): created successfully
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee6091f-e58e-45ec-aef4-c11aefa2e5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:32:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Flow 'volume_create_manager' (2d052ac4-6257-497b-bd16-d7368b0163b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:32:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-18eae839-8259-4eba-964f-db21a0b1d5d8 tempest-VolumesActionsTest-1826545137 None] Created volume successfully.
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.095s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "cinder-6071dff6-f7bf-4905-ac29-5cf6944e5844-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-6071dff6-f7bf-4905-ac29-5cf6944e5844-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:49 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:32:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "cinder-quobyte-6071dff6-f7bf-4905-ac29-5cf6944e5844" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:32:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-quobyte-6071dff6-f7bf-4905-ac29-5cf6944e5844" acquired by "delete_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:32:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d29e75-2cef-4d20-a257-21ac512adb7c]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:32:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844" returned: 0 in 0.391s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-6071dff6-f7bf-4905-ac29-5cf6944e5844" returned: 0 in 0.088s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-quobyte-6071dff6-f7bf-4905-ac29-5cf6944e5844" released by "delete_volume" :: held 0.647s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:32:50 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Created reservations ['a6c74bf0-ec59-419a-9756-2736c23eb4d7', '174c5bcb-cd5d-470c-9037-7bdf14a428f8', '29c4fce6-dbeb-4561-8328-de80090863e2', 'e956b6de-00a6-4345-aead-52dd4192865e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:32:51 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Deleted volume successfully.
Sep 03 08:32:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4da1ab21-bfec-47ef-997b-c8ac1dbaa311 tempest-VolumesActionsTest-1826545137 None] Lock "cinder-6071dff6-f7bf-4905-ac29-5cf6944e5844-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=43,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=9 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:33:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=66,cinder:DELETE=5,cinder:SELECT=45,cinder:INSERT=17 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:33:06 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Flow 'volume_create_manager' (24712828-e3a6-4712-9871-5bc5d37e3d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1d96d-c0e3-4cde-9d51-8cc5c06805c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1d96d-c0e3-4cde-9d51-8cc5c06805c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1913952626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98838f44-c725-4a35-9a36-cc9a0ec2cf40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f6c0d556c34e8398d9bc572b10b386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:06Z,use_quota=True,user_id='4826a44b50004b60afae3b814b2d4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc2cefd-1a66-46f4-b83e-6260360825ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc2cefd-1a66-46f4-b83e-6260360825ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0169e4f-f9f9-40b0-904a-f95ef924a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0169e4f-f9f9-40b0-904a-f95ef924a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98838f44-c725-4a35-9a36-cc9a0ec2cf40', 'volume_name': 'volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0406c64c-ae5c-4dad-8ae5-735f5ae8ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0406c64c-ae5c-4dad-8ae5-735f5ae8ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31aa82cc-0e39-4b8b-8ab7-6bbade5ae4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:06 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Volume 98838f44-c725-4a35-9a36-cc9a0ec2cf40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40', 'volume_size': 1}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1913952626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98838f44-c725-4a35-9a36-cc9a0ec2cf40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f6c0d556c34e8398d9bc572b10b386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:06Z,use_quota=True,user_id='4826a44b50004b60afae3b814b2d4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Creating volume 98838f44-c725-4a35-9a36-cc9a0ec2cf40 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:33:06 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:06 devstack quobyte-client[82407]: System call of process 96762 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:06 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=110, name=volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40 1073741824" returned: 0 in 0.343s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] <== create_volume: return (496ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:33:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.509s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31aa82cc-0e39-4b8b-8ab7-6bbade5ae4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e825656a-b799-41c9-92b9-5d0693df8d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:07 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Volume volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40 (98838f44-c725-4a35-9a36-cc9a0ec2cf40): created successfully
Sep 03 08:33:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e825656a-b799-41c9-92b9-5d0693df8d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:07 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Flow 'volume_create_manager' (24712828-e3a6-4712-9871-5bc5d37e3d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:07 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cae8fd34-bcf5-475b-bdd5-8e42483a8a96 tempest-VolumesListAdminTestJSON-1547560063 None] Created volume successfully.
Sep 03 08:33:08 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Flow 'volume_create_manager' (b852b914-4f49-43bd-b9bb-389102a78f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3930e47-0cf5-43a3-b9cd-4fcf3f22329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3930e47-0cf5-43a3-b9cd-4fcf3f22329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1909120376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d921221b-86a2-4aef-9cc9-0405fc21c942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f6c0d556c34e8398d9bc572b10b386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:09Z,use_quota=True,user_id='4826a44b50004b60afae3b814b2d4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fc3090-a6c2-46fd-9a64-3831ffb1e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fc3090-a6c2-46fd-9a64-3831ffb1e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3326487e-1c1d-4af8-9873-1162a96f4f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3326487e-1c1d-4af8-9873-1162a96f4f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd921221b-86a2-4aef-9cc9-0405fc21c942', 'volume_name': 'volume-d921221b-86a2-4aef-9cc9-0405fc21c942', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8742f920-11d7-4e39-88d8-9d880aebb088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8742f920-11d7-4e39-88d8-9d880aebb088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd1bb4f-f056-4589-9e80-7c014b51bc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:08 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Volume d921221b-86a2-4aef-9cc9-0405fc21c942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d921221b-86a2-4aef-9cc9-0405fc21c942', 'volume_size': 1}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1909120376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d921221b-86a2-4aef-9cc9-0405fc21c942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f6c0d556c34e8398d9bc572b10b386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:09Z,use_quota=True,user_id='4826a44b50004b60afae3b814b2d4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Creating volume d921221b-86a2-4aef-9cc9-0405fc21c942 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:33:08 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:33:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:09 devstack quobyte-client[82407]: System call of process 96766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:09 devstack quobyte-client[82407]: System call of process 96766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:09 devstack quobyte-client[82407]: System call of process 96766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:09 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=111, name=volume-d921221b-86a2-4aef-9cc9-0405fc21c942, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942 1073741824" returned: 0 in 0.343s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942" returned: 0 in 0.087s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] <== create_volume: return (489ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.503s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd1bb4f-f056-4589-9e80-7c014b51bc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d921221b-86a2-4aef-9cc9-0405fc21c942', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d4a7bf-9afb-4357-af1f-0eb62ddf10d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:09 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Volume volume-d921221b-86a2-4aef-9cc9-0405fc21c942 (d921221b-86a2-4aef-9cc9-0405fc21c942): created successfully
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d4a7bf-9afb-4357-af1f-0eb62ddf10d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Flow 'volume_create_manager' (b852b914-4f49-43bd-b9bb-389102a78f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:09 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-28c46bfa-2a05-4852-91af-57e382a530fc tempest-VolumesListAdminTestJSON-1547560063 None] Created volume successfully.
Sep 03 08:33:10 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Flow 'volume_create_manager' (af850f55-c6af-43c3-9fed-f4ed3882002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23e2677-9ad5-4857-abca-d1a91ec6d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23e2677-9ad5-4857-abca-d1a91ec6d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2054540156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cedaa14-834d-4ce1-9613-d743f2653978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f6c0d556c34e8398d9bc572b10b386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:10Z,use_quota=True,user_id='4826a44b50004b60afae3b814b2d4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ce8bf4-a799-427c-a32a-2782ec9bdd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ce8bf4-a799-427c-a32a-2782ec9bdd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed7e0af-7981-4259-bd3c-1b8dcccab4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed7e0af-7981-4259-bd3c-1b8dcccab4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cedaa14-834d-4ce1-9613-d743f2653978', 'volume_name': 'volume-0cedaa14-834d-4ce1-9613-d743f2653978', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00a692e-ad49-4a6f-9c3d-db427d2f18c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00a692e-ad49-4a6f-9c3d-db427d2f18c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431234bb-ab3f-47b6-b1ba-4d86806606e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:10 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Volume 0cedaa14-834d-4ce1-9613-d743f2653978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cedaa14-834d-4ce1-9613-d743f2653978', 'volume_size': 1}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2054540156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cedaa14-834d-4ce1-9613-d743f2653978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f6c0d556c34e8398d9bc572b10b386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:10Z,use_quota=True,user_id='4826a44b50004b60afae3b814b2d4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Creating volume 0cedaa14-834d-4ce1-9613-d743f2653978 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:33:10 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:10 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=112, name=volume-0cedaa14-834d-4ce1-9613-d743f2653978, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978 1073741824" returned: 0 in 0.349s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978" returned: 0 in 0.083s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] <== create_volume: return (487ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:33:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431234bb-ab3f-47b6-b1ba-4d86806606e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cedaa14-834d-4ce1-9613-d743f2653978', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc64615-9017-4df2-9db3-16938b589ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:11 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Volume volume-0cedaa14-834d-4ce1-9613-d743f2653978 (0cedaa14-834d-4ce1-9613-d743f2653978): created successfully
Sep 03 08:33:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc64615-9017-4df2-9db3-16938b589ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Flow 'volume_create_manager' (af850f55-c6af-43c3-9fed-f4ed3882002c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:11 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-9914f7ac-76f6-4f83-bb39-90468a45683f tempest-VolumesListAdminTestJSON-1547560063 None] Created volume successfully.
Sep 03 08:33:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:11 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:33:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Flow 'volume_create_manager' (03c0d90a-e2a9-4749-803e-3fa9664d84a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:11 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f9614f-c404-4028-8bdc-30c3b79f3cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f9614f-c404-4028-8bdc-30c3b79f3cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886c9b30-5fcc-44e4-9274-27c224de8cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bea155b559341018d64c1a44e1f412f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:12Z,use_quota=True,user_id='9e2a9a04ead2465db53e1b689faad5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67690d1-8549-4969-8ef5-dac96c1a551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67690d1-8549-4969-8ef5-dac96c1a551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee97fba-9295-4d5b-85c2-64c31536a4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee97fba-9295-4d5b-85c2-64c31536a4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886c9b30-5fcc-44e4-9274-27c224de8cdc', 'volume_name': 'volume-886c9b30-5fcc-44e4-9274-27c224de8cdc', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19d3dbe-d539-45c3-a5f8-e63e7e018f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19d3dbe-d539-45c3-a5f8-e63e7e018f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25244dd3-f037-456a-ad4c-c05722599cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:12 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Volume 886c9b30-5fcc-44e4-9274-27c224de8cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886c9b30-5fcc-44e4-9274-27c224de8cdc', 'volume_size': 1}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886c9b30-5fcc-44e4-9274-27c224de8cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bea155b559341018d64c1a44e1f412f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:12Z,use_quota=True,user_id='9e2a9a04ead2465db53e1b689faad5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Creating volume 886c9b30-5fcc-44e4-9274-27c224de8cdc {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:33:12 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:12 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=113, name=volume-886c9b30-5fcc-44e4-9274-27c224de8cdc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc 1073741824" returned: 0 in 0.322s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] <== create_volume: return (517ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25244dd3-f037-456a-ad4c-c05722599cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886c9b30-5fcc-44e4-9274-27c224de8cdc', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18be50a-94b8-4ace-b603-ee2bf9c92db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:12 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Volume volume-886c9b30-5fcc-44e4-9274-27c224de8cdc (886c9b30-5fcc-44e4-9274-27c224de8cdc): created successfully
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18be50a-94b8-4ace-b603-ee2bf9c92db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:12 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Flow 'volume_create_manager' (03c0d90a-e2a9-4749-803e-3fa9664d84a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-29c87597-ce17-4add-87d3-93d87df889a3 tempest-VolumesListAdminTestJSON-126884292 None] Created volume successfully.
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Acquiring lock "cinder-886c9b30-5fcc-44e4-9274-27c224de8cdc-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Lock "cinder-886c9b30-5fcc-44e4-9274-27c224de8cdc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Acquiring lock "cinder-quobyte-886c9b30-5fcc-44e4-9274-27c224de8cdc" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Lock "cinder-quobyte-886c9b30-5fcc-44e4-9274-27c224de8cdc" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "cinder-0cedaa14-834d-4ce1-9613-d743f2653978-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084fd21-ab50-43c5-8b9b-7c733294f790]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-0cedaa14-834d-4ce1-9613-d743f2653978-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "cinder-quobyte-0cedaa14-834d-4ce1-9613-d743f2653978" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:14 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-quobyte-0cedaa14-834d-4ce1-9613-d743f2653978" acquired by "delete_volume" :: waited 0.028s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f604c70e-1f5b-4d21-a0ed-ce2257eaf574]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc" returned: 0 in 0.626s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-886c9b30-5fcc-44e4-9274-27c224de8cdc" returned: 0 in 0.095s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Lock "cinder-quobyte-886c9b30-5fcc-44e4-9274-27c224de8cdc" released by "delete_volume" :: held 0.914s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:15 devstack quobyte-client[82407]: System call of process 96782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978" returned: 0 in 0.631s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-0cedaa14-834d-4ce1-9613-d743f2653978" returned: 0 in 0.168s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-quobyte-0cedaa14-834d-4ce1-9613-d743f2653978" released by "delete_volume" :: held 0.921s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:15 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Created reservations ['bf86d1a1-ada8-4764-a569-052558f10a48', 'e687fc60-0051-4321-88aa-6f6c9c475102', '44ee329e-fc04-4049-88d3-394187a55077', '5ec17853-fbaa-43ed-9369-7dfc40bc7a2f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Created reservations ['ed2d23d7-32f3-42c9-a915-654261582ca3', '3247904e-0edb-4d61-88a3-e58008a68d23', '7a1e085b-147e-4109-ac7a-f421bcd2085f', 'e6b74b0a-eff3-4799-afca-054298ec52d8'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.235s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:16 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Deleted volume successfully.
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4fc6ded5-3493-44ed-86e5-7affa7eaa223 tempest-VolumesListAdminTestJSON-126884292 None] Lock "cinder-886c9b30-5fcc-44e4-9274-27c224de8cdc-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.095s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:16 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Deleted volume successfully.
Sep 03 08:33:16 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "cinder-d921221b-86a2-4aef-9cc9-0405fc21c942-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8c0884a3-3150-4ffd-bad1-8e0475adc754 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-0cedaa14-834d-4ce1-9613-d743f2653978-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-d921221b-86a2-4aef-9cc9-0405fc21c942-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:17 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "cinder-quobyte-d921221b-86a2-4aef-9cc9-0405fc21c942" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-quobyte-d921221b-86a2-4aef-9cc9-0405fc21c942" acquired by "delete_volume" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[85edae79-7af6-4650-805e-a000077fa230]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942" returned: 0 in 0.393s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d921221b-86a2-4aef-9cc9-0405fc21c942" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:17 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-quobyte-d921221b-86a2-4aef-9cc9-0405fc21c942" released by "delete_volume" :: held 0.611s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Created reservations ['22a40418-d1a4-432d-b9eb-b7c83084e74f', 'f7274be1-7ceb-4983-a8c2-84e0ef55de72', 'c876b2d1-9fd3-454e-85fe-47b9cca18eb6', '377d820e-1192-4dce-91af-0ce08b4b908e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:18 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:18 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Deleted volume successfully.
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-907086be-f8c7-45d3-bbcf-d9b414f1e159 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-d921221b-86a2-4aef-9cc9-0405fc21c942-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "cinder-98838f44-c725-4a35-9a36-cc9a0ec2cf40-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-98838f44-c725-4a35-9a36-cc9a0ec2cf40-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:19 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "cinder-quobyte-98838f44-c725-4a35-9a36-cc9a0ec2cf40" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-quobyte-98838f44-c725-4a35-9a36-cc9a0ec2cf40" acquired by "delete_volume" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb319fec-aa0a-4706-aaff-d36b5be9ae40]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40" returned: 0 in 0.376s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-98838f44-c725-4a35-9a36-cc9a0ec2cf40" returned: 0 in 0.098s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-quobyte-98838f44-c725-4a35-9a36-cc9a0ec2cf40" released by "delete_volume" :: held 0.603s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Created reservations ['4c264fd2-7fb7-4c27-a9c5-9b3110573334', 'b31238ce-809d-4374-bec5-02b9432c3a2f', '027a0dff-10e2-40e8-b1d2-4e08132a5752', 'fe35b620-19bb-4b71-8490-833f57a0ba03'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Deleted volume successfully.
Sep 03 08:33:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3fd4e7c3-203c-4388-8147-b05dd77b11b5 tempest-VolumesListAdminTestJSON-1547560063 None] Lock "cinder-98838f44-c725-4a35-9a36-cc9a0ec2cf40-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Flow 'volume_create_manager' (1d8b94f7-36bb-41af-becf-7c37b3609bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f440124-3002-484a-92b5-ac5101bb70a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f440124-3002-484a-92b5-ac5101bb70a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-953226179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fdffe7-6d12-4d7d-89da-527d2c6f5870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af96cd554249e1af1ea4072f7e1d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:25Z,use_quota=True,user_id='d01e134808a8400783d1fa201d3077c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec16b6eb-3db5-4f4d-8da5-93244840d1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec16b6eb-3db5-4f4d-8da5-93244840d1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc013a3-012c-4ced-8ebf-bb7716dfa9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc013a3-012c-4ced-8ebf-bb7716dfa9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86fdffe7-6d12-4d7d-89da-527d2c6f5870', 'volume_name': 'volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108e348d-dc7b-4901-889b-dd7ec83db861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108e348d-dc7b-4901-889b-dd7ec83db861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d90faa4-85b7-4b63-a7e2-f54e773918ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:25 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Volume 86fdffe7-6d12-4d7d-89da-527d2c6f5870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870', 'volume_size': 1}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-953226179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fdffe7-6d12-4d7d-89da-527d2c6f5870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af96cd554249e1af1ea4072f7e1d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:25Z,use_quota=True,user_id='d01e134808a8400783d1fa201d3077c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Creating volume 86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:33:25 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=114, name=volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 1073741824" returned: 0 in 0.357s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] <== create_volume: return (501ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:33:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.513s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d90faa4-85b7-4b63-a7e2-f54e773918ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c16323-2edd-4639-873d-f7abf7038370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Volume volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 (86fdffe7-6d12-4d7d-89da-527d2c6f5870): created successfully
Sep 03 08:33:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c16323-2edd-4639-873d-f7abf7038370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Flow 'volume_create_manager' (1d8b94f7-36bb-41af-becf-7c37b3609bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2fa94df8-9e91-4059-b600-bcece1be1bb3 tempest-VolumesDeleteCascade-111445302 None] Created volume successfully.
Sep 03 08:33:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Creating offline snapshot c0398d38-7e1f-46b9-b6e2-55439686e39f of volume 86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:33:27 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd43027-c661-4572-a5e3-2b6d0eb80744]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870" returned: 0 in 0.432s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:28 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=115, name=volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f 1G" returned: 0 in 0.233s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img rebase -u -b volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img rebase -u -b volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.121s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.087s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:33:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.info" returned: 0 in 0.097s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:33:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.info" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.450s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b8ca3a6c-1f90-45b2-9d0e-861b25a18e8d tempest-VolumesDeleteCascade-111445302 None] Create snapshot completed successfully
Sep 03 08:33:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Creating offline snapshot 5dbeb519-373a-465a-a846-1b49706f609e of volume 86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[2319f216-7f73-4ae9-af61-83d0f44c4b6d]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:30 devstack quobyte-client[82407]: System call of process 96819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.463s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:33:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:30 devstack quobyte-client[82407]: System call of process 96822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:30 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=117, name=volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e 1G" returned: 0 in 0.284s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img rebase -u -b volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img rebase -u -b volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e" returned: 0 in 0.131s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e" returned: 0 in 0.090s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.332s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b17ebfe8-8701-4a8e-893c-27837aa80600 tempest-VolumesDeleteCascade-111445302 None] Create snapshot completed successfully
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-86fdffe7-6d12-4d7d-89da-527d2c6f5870-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-86fdffe7-6d12-4d7d-89da-527d2c6f5870-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Performing cascade delete. {{(pid=82397) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-5dbeb519-373a-465a-a846-1b49706f609e-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-5dbeb519-373a-465a-a846-1b49706f609e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-5dbeb519-373a-465a-a846-1b49706f609e" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-5dbeb519-373a-465a-a846-1b49706f609e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Deleting offline snapshot 5dbeb519-373a-465a-a846-1b49706f609e of volume 86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] snapshot_file for this snap is: volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da05f5b-1c0b-4d07-8c20-ea7164e09615]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e" returned: 0 in 0.379s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f4b727-fed0-4c58-8a33-be755331ab81]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.384s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e" returned: 0 in 0.251s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.5dbeb519-373a-465a-a846-1b49706f609e" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-5dbeb519-373a-465a-a846-1b49706f609e" released by "_delete_snapshot" :: held 1.359s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" released by "delete_snapshot" :: held 1.381s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Created reservations ['a0562737-574c-4d88-bdfb-0a455271437c', '60e8c44c-b189-49b1-9ea5-ea2521bc4b1c', '423c9855-962b-43c2-a2ba-49249d236b51', 'ae488136-3de5-4317-ae2b-b1d88a429877'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Delete snapshot completed successfully.
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-5dbeb519-373a-465a-a846-1b49706f609e-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-c0398d38-7e1f-46b9-b6e2-55439686e39f-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-c0398d38-7e1f-46b9-b6e2-55439686e39f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:34 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-c0398d38-7e1f-46b9-b6e2-55439686e39f" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-c0398d38-7e1f-46b9-b6e2-55439686e39f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Deleting offline snapshot c0398d38-7e1f-46b9-b6e2-55439686e39f of volume 86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] snapshot_file for this snap is: volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c83f769-c615-44e4-8807-ded9fff9ad7d]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.402s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[de77979f-e236-472c-9cc0-760f4d167ee5]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870" returned: 0 in 0.378s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.181s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870.c0398d38-7e1f-46b9-b6e2-55439686e39f" returned: 0 in 0.117s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-c0398d38-7e1f-46b9-b6e2-55439686e39f" released by "_delete_snapshot" :: held 1.334s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" released by "delete_snapshot" :: held 1.354s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Created reservations ['9b677e39-c795-4844-852d-3a8a6295f477', '71be10e4-4619-4eee-8bf1-06413a3adeb3', 'd9f65f71-f7db-41e3-af8f-9a8172617317', 'f6fb6e90-163f-4d4c-aff1-38662ac15ea4'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:36 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Delete snapshot completed successfully.
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-c0398d38-7e1f-46b9-b6e2-55439686e39f-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Snapshots deleted, issuing volume delete {{(pid=82397) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" acquired by "delete_volume" :: waited 0.022s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7c9bd-8c1a-404a-b2d2-640f070375ae]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870" returned: 0 in 0.389s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-86fdffe7-6d12-4d7d-89da-527d2c6f5870" returned: 0 in 0.111s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-86fdffe7-6d12-4d7d-89da-527d2c6f5870" released by "delete_volume" :: held 0.648s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Created reservations ['71b432d9-ce4b-4a11-8b12-a5d8d0d8002b', 'bd08d9f7-44f3-4d0b-a70f-ed955bfb83be', '4deef93b-e113-4982-a3ec-f63b4f9517ca', 'e1e91fc8-a9e8-49af-8b20-928504349d75'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.075s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Deleted volume successfully.
Sep 03 08:33:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b157c9d9-589b-4f73-806e-0427da58d58c tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-86fdffe7-6d12-4d7d-89da-527d2c6f5870-delete_volume" released by "delete_volume" :: held 5.149s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:38 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Flow 'volume_create_manager' (a67505be-e079-4b79-b738-f3d6d64fc304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dccbb4-3636-48bb-a30b-32c46d6c6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dccbb4-3636-48bb-a30b-32c46d6c6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1554866491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96012a79-ffa8-4b6e-ae10-c567a098e56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af96cd554249e1af1ea4072f7e1d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:38Z,use_quota=True,user_id='d01e134808a8400783d1fa201d3077c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec80d70d-0b3e-45fb-affc-16192cb44d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec80d70d-0b3e-45fb-affc-16192cb44d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504e1b85-4e2c-4153-9825-29b49fbad23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504e1b85-4e2c-4153-9825-29b49fbad23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96012a79-ffa8-4b6e-ae10-c567a098e56a', 'volume_name': 'volume-96012a79-ffa8-4b6e-ae10-c567a098e56a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927088f5-5e97-481f-a8ac-fe66908f9857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927088f5-5e97-481f-a8ac-fe66908f9857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdb7143-6087-4b03-8dae-81e8a91f77a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:38 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Volume 96012a79-ffa8-4b6e-ae10-c567a098e56a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96012a79-ffa8-4b6e-ae10-c567a098e56a', 'volume_size': 1}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1554866491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96012a79-ffa8-4b6e-ae10-c567a098e56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af96cd554249e1af1ea4072f7e1d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:38Z,use_quota=True,user_id='d01e134808a8400783d1fa201d3077c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Creating volume 96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:33:38 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:33:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:38 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=118, name=volume-96012a79-ffa8-4b6e-ae10-c567a098e56a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:38 devstack quobyte-client[82407]: System call of process 96856 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a 1073741824" returned: 0 in 0.345s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a" returned: 0 in 0.093s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] <== create_volume: return (499ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.509s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdb7143-6087-4b03-8dae-81e8a91f77a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96012a79-ffa8-4b6e-ae10-c567a098e56a', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a37bb35-55aa-4a37-80b5-3fde50eb8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:39 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Volume volume-96012a79-ffa8-4b6e-ae10-c567a098e56a (96012a79-ffa8-4b6e-ae10-c567a098e56a): created successfully
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a37bb35-55aa-4a37-80b5-3fde50eb8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Flow 'volume_create_manager' (a67505be-e079-4b79-b738-f3d6d64fc304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:39 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d4ffb121-9396-4fac-80c4-8696cee8f721 tempest-VolumesDeleteCascade-111445302 None] Created volume successfully.
Sep 03 08:33:40 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Creating offline snapshot 6a823e04-6381-4d2c-9641-50e8e70ab53d of volume 96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:33:40 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa417fa4-0b34-4a88-920d-21df2396b142]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a" returned: 0 in 0.394s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:41 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=119, name=volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d 1G" returned: 0 in 0.242s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img rebase -u -b volume-96012a79-ffa8-4b6e-ae10-c567a098e56a -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img rebase -u -b volume-96012a79-ffa8-4b6e-ae10-c567a098e56a -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d" returned: 0 in 0.135s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d" returned: 0 in 0.076s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d" returned: 0 in 0.097s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.info" returned: 0 in 0.090s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:33:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.info" returned: 0 in 0.077s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.414s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:42 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2366ae6a-c6f9-4a86-ac22-57ee4db7f3d6 tempest-VolumesDeleteCascade-111445302 None] Create snapshot completed successfully
Sep 03 08:33:43 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Flow 'volume_create_manager' (48ddb9e5-085d-4a04-ba44-31fd3b104e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64033495-be07-4cea-aa61-554a0a641331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64033495-be07-4cea-aa61-554a0a641331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-345299607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6af96cd554249e1af1ea4072f7e1d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6a823e04-6381-4d2c-9641-50e8e70ab53d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:33:43Z,use_quota=True,user_id='d01e134808a8400783d1fa201d3077c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c78b95b-a868-4630-b9ff-e4d56e3d23b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c78b95b-a868-4630-b9ff-e4d56e3d23b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17968f9-bea0-4110-b53f-49fd87670816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17968f9-bea0-4110-b53f-49fd87670816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0', 'volume_name': 'volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0', 'volume_size': 1, 'snapshot_id': '6a823e04-6381-4d2c-9641-50e8e70ab53d'}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee46cf6e-9df1-46c7-8d9f-8868b01dfe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee46cf6e-9df1-46c7-8d9f-8868b01dfe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d62729-9609-4318-ac14-af777dbfc07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:43 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Volume 9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0', 'volume_size': 1, 'snapshot_id': '6a823e04-6381-4d2c-9641-50e8e70ab53d'}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-6a823e04-6381-4d2c-9641-50e8e70ab53d-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" by "_create_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-6a823e04-6381-4d2c-9641-50e8e70ab53d-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Creating volume 9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 from snapshot 6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" by "_copy_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] snapshot: 6a823e04-6381-4d2c-9641-50e8e70ab53d, volume: 9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0,  {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd3601c-1a88-4240-bb2f-d57676f44a1a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d" returned: 0 in 0.364s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96012a79-ffa8-4b6e-ae10-c567a098e56a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Creating direct copy from snapshot {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7699af-7d44-4c91-b082-864415863ac2]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a" returned: 0 in 0.406s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG cinder.utils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 not found in is_blk_device check {{(pid=82397) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 03 08:33:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:44 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=121, name=volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:33:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:33:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.265s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" returned: 0 in 6.131s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[da538b87-fd38-4f51-977d-8155adec913b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a" returned: 0 in 0.508s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:33:51 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Converted 1024.00 MB image at 166.54 MB/s
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" returned: 0 in 0.078s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" released by "_copy_volume_from_snapshot" :: held 7.854s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-6a823e04-6381-4d2c-9641-50e8e70ab53d-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" released by "_create_volume_from_snapshot" :: held 7.890s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.910s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d62729-9609-4318-ac14-af777dbfc07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0', 'volume_size': 1, 'snapshot_id': '6a823e04-6381-4d2c-9641-50e8e70ab53d'}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94872c1d-a434-44b1-8154-b4baf08e8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:33:51 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Volume volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 (9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0): created successfully
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94872c1d-a434-44b1-8154-b4baf08e8574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:33:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Flow 'volume_create_manager' (48ddb9e5-085d-4a04-ba44-31fd3b104e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:33:51 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d39a0be0-1cd0-4599-bc42-da2245e3f44a tempest-VolumesDeleteCascade-111445302 None] Created volume successfully.
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-96012a79-ffa8-4b6e-ae10-c567a098e56a-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-96012a79-ffa8-4b6e-ae10-c567a098e56a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Performing cascade delete. {{(pid=82397) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-6a823e04-6381-4d2c-9641-50e8e70ab53d-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-6a823e04-6381-4d2c-9641-50e8e70ab53d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:52 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-96012a79-ffa8-4b6e-ae10-c567a098e56a" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-96012a79-ffa8-4b6e-ae10-c567a098e56a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-6a823e04-6381-4d2c-9641-50e8e70ab53d" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-6a823e04-6381-4d2c-9641-50e8e70ab53d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Deleting offline snapshot 6a823e04-6381-4d2c-9641-50e8e70ab53d of volume 96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] snapshot_file for this snap is: volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3048a-5ee6-45d5-a5ae-d81c43d35bee]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d" returned: 0 in 0.350s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96012a79-ffa8-4b6e-ae10-c567a098e56a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:33:53 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f720484a-9891-49ea-acaa-f3ea2e0ff697]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a" returned: 0 in 0.391s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:53 devstack quobyte-client[82407]: System call of process 96913 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d" returned: 0 in 0.205s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a.6a823e04-6381-4d2c-9641-50e8e70ab53d" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-6a823e04-6381-4d2c-9641-50e8e70ab53d" released by "_delete_snapshot" :: held 1.283s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-96012a79-ffa8-4b6e-ae10-c567a098e56a" released by "delete_snapshot" :: held 1.302s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Created reservations ['66930a78-ffc7-4749-8ffd-b291e694ebb6', '7f2c02b2-a8c6-4f7e-a911-17c472f58153', 'c788867a-6926-4bf1-98ed-0e7b0031326b', '60f7709c-0e13-46f5-b974-47b7615d2f25'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:54 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Delete snapshot completed successfully.
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-6a823e04-6381-4d2c-9641-50e8e70ab53d-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Snapshots deleted, issuing volume delete {{(pid=82397) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-96012a79-ffa8-4b6e-ae10-c567a098e56a" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-96012a79-ffa8-4b6e-ae10-c567a098e56a" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba89001-11f1-45f0-ae6c-48dcdefeaf93]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a" returned: 0 in 0.388s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-96012a79-ffa8-4b6e-ae10-c567a098e56a" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-96012a79-ffa8-4b6e-ae10-c567a098e56a" released by "delete_volume" :: held 0.641s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Created reservations ['a46a2e26-eb1c-4df2-aa95-7f7985bf1a20', '0884ad16-3843-4534-938d-d39635107491', 'd82ab8e8-1742-4950-a702-63757145d3e0', 'a47e586b-dd7f-4aff-8be9-a10a7f7f7e11'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.117s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:55 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:55 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Deleted volume successfully.
Sep 03 08:33:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-82e64177-812d-45e9-a6b6-abd1ecfa8aa8 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-96012a79-ffa8-4b6e-ae10-c567a098e56a-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:33:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "cinder-quobyte-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:33:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:33:56 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3217b0a1-b612-4af1-bbd0-0e8a29f406d4]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:33:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" returned: 0 in 0.419s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" returned: 0 in 0.095s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-quobyte-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0" released by "delete_volume" :: held 0.650s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Created reservations ['4591761e-d471-4c31-9525-af780747f7dd', 'b9d57c0b-a4d8-4b0c-8da5-1f32c9539d05', 'b5d6c9d6-4dd2-4a88-ab5f-b086685e35dd', 'a99de98f-2d07-4a5a-94b9-6a68bfd6fcc0'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.098s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:33:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Deleted volume successfully.
Sep 03 08:33:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5d30defe-685b-4322-81af-9641ca814675 tempest-VolumesDeleteCascade-111445302 None] Lock "cinder-9231af2f-42f6-42cd-bbe4-f7d8e67fcfb0-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:02 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=63,cinder:UPDATE=86,cinder:DELETE=7,cinder:INSERT=15 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:34:02 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=94,cinder:SELECT=66,cinder:DELETE=10,cinder:INSERT=25 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:34:03 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Flow 'volume_create_manager' (9ec6c8b3-7ad5-4390-8c05-bb9be73e43aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc42280-120a-4343-b3da-38881ce91eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc42280-120a-4343-b3da-38881ce91eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1456830775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ace474-6dd0-4710-9d90-f9ab3c2ffaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ea522b30ac4e80bd9a1ebc789e6528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:03Z,use_quota=True,user_id='f7b1df2744e6406ba20d9ad9856db980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe23cca-06ec-4e4d-adc5-5a3ec02939cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe23cca-06ec-4e4d-adc5-5a3ec02939cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a87f137-7607-454d-b908-ad1eea78b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a87f137-7607-454d-b908-ad1eea78b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ace474-6dd0-4710-9d90-f9ab3c2ffaba', 'volume_name': 'volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b292def5-ff7f-43e8-8dba-51a61a2a49ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b292def5-ff7f-43e8-8dba-51a61a2a49ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bb0f8f-ddeb-44e5-bc2e-39523258de4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:03 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Volume 55ace474-6dd0-4710-9d90-f9ab3c2ffaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba', 'volume_size': 1}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1456830775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ace474-6dd0-4710-9d90-f9ab3c2ffaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ea522b30ac4e80bd9a1ebc789e6528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:03Z,use_quota=True,user_id='f7b1df2744e6406ba20d9ad9856db980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Creating volume 55ace474-6dd0-4710-9d90-f9ab3c2ffaba {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:34:03 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:03 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=122, name=volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba 1073741824" returned: 0 in 0.332s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] <== create_volume: return (467ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.478s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bb0f8f-ddeb-44e5-bc2e-39523258de4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69485de-f27d-4119-a396-6f01ae697d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:03 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Volume volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba (55ace474-6dd0-4710-9d90-f9ab3c2ffaba): created successfully
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69485de-f27d-4119-a396-6f01ae697d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:03 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Flow 'volume_create_manager' (9ec6c8b3-7ad5-4390-8c05-bb9be73e43aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:03 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5e5c0ec7-ccd7-4248-a078-ad8cde4657a6 tempest-VolumesTransfersTest-87056551 None] Created volume successfully.
Sep 03 08:34:05 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4a7d7fd0-2b43-468b-b433-2d4e1e1bf7dd tempest-VolumesTransfersTest-341053336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4a7d7fd0-2b43-468b-b433-2d4e1e1bf7dd tempest-VolumesTransfersTest-341053336 None] Transfer volume completed successfully.
Sep 03 08:34:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Acquiring lock "cinder-55ace474-6dd0-4710-9d90-f9ab3c2ffaba-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-55ace474-6dd0-4710-9d90-f9ab3c2ffaba-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:06 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Acquiring lock "cinder-quobyte-55ace474-6dd0-4710-9d90-f9ab3c2ffaba" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-quobyte-55ace474-6dd0-4710-9d90-f9ab3c2ffaba" acquired by "delete_volume" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b61ecb-555c-44b7-9ef6-bcfe77eaba76]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:34:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba" returned: 0 in 0.398s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-55ace474-6dd0-4710-9d90-f9ab3c2ffaba" returned: 0 in 0.096s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-quobyte-55ace474-6dd0-4710-9d90-f9ab3c2ffaba" released by "delete_volume" :: held 0.618s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Created reservations ['ea294f9e-2034-4b55-af71-c3ce1b2afdc9', '528d2386-9f8e-4ea2-812e-84a0ddc91e68', '100920fd-50cd-42e4-a1f6-dd5344e1252d', '2e3911b2-b8b4-4f3c-8d45-35f22a1d70f5'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.133s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:07 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:34:07 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Deleted volume successfully.
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-3a44a78d-397a-4286-8c4f-3c79e27068cf tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-55ace474-6dd0-4710-9d90-f9ab3c2ffaba-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:08 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Flow 'volume_create_manager' (dffae48a-9589-4a12-ba4a-15eb3971d6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8c0f66-fbea-4e98-bc5a-763decacf613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8c0f66-fbea-4e98-bc5a-763decacf613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-412114967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e1ac13-41f2-42bc-9b4b-42126f95fe6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ea522b30ac4e80bd9a1ebc789e6528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:08Z,use_quota=True,user_id='f7b1df2744e6406ba20d9ad9856db980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2d0e7a-106e-45d9-93ae-8e665d0d2717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2d0e7a-106e-45d9-93ae-8e665d0d2717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2cfcce-c513-4c3b-a22c-584f60ab1433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2cfcce-c513-4c3b-a22c-584f60ab1433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e1ac13-41f2-42bc-9b4b-42126f95fe6f', 'volume_name': 'volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fde3b-8426-4d44-9f5c-384bb8d5a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fde3b-8426-4d44-9f5c-384bb8d5a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1097ac-7823-4a74-af4d-3107b77cfc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:08 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Volume f4e1ac13-41f2-42bc-9b4b-42126f95fe6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f', 'volume_size': 1}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-412114967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e1ac13-41f2-42bc-9b4b-42126f95fe6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ea522b30ac4e80bd9a1ebc789e6528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:08Z,use_quota=True,user_id='f7b1df2744e6406ba20d9ad9856db980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Creating volume f4e1ac13-41f2-42bc-9b4b-42126f95fe6f {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:34:08 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:34:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:08 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=123, name=volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f 1073741824" returned: 0 in 0.306s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f" returned: 0 in 0.083s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] <== create_volume: return (455ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.466s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1097ac-7823-4a74-af4d-3107b77cfc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b082a3b-46f4-4998-9ff8-04d6b3bec480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:09 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Volume volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f (f4e1ac13-41f2-42bc-9b4b-42126f95fe6f): created successfully
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b082a3b-46f4-4998-9ff8-04d6b3bec480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:09 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Flow 'volume_create_manager' (dffae48a-9589-4a12-ba4a-15eb3971d6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:09 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2093f46d-b56d-4c0f-8fae-e54802c9a7a0 tempest-VolumesTransfersTest-87056551 None] Created volume successfully.
Sep 03 08:34:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Acquiring lock "cinder-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Acquiring lock "cinder-quobyte-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-quobyte-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f" acquired by "delete_volume" :: waited 0.009s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a243470-050f-43a3-9b29-2455d47187b9]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f" returned: 0 in 0.387s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-quobyte-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f" released by "delete_volume" :: held 0.617s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:11 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Created reservations ['4b438150-6b57-4c30-b701-a75f84a039bc', '9c7d0fca-23f7-447d-a521-98741b224567', '852b2718-dc67-4281-b109-f77791abfbaa', '9fd8e4de-5501-44cf-a4e6-fa15ea3828fd'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.107s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:34:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Deleted volume successfully.
Sep 03 08:34:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5bad0f4b-ecdf-425f-ae0e-4dfc2406eb6a tempest-VolumesTransfersTest-1840184073 None] Lock "cinder-f4e1ac13-41f2-42bc-9b4b-42126f95fe6f-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:19 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:19 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Flow 'volume_create_manager' (8256a8b3-402f-4031-b7b7-68c3531a1f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab22da91-1882-46ee-bfee-3f83c9005b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab22da91-1882-46ee-bfee-3f83c9005b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-950478648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfcf7d9-811f-4df1-a5af-1ea5485334bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e14f92234c4126b0806aab368eab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:20Z,use_quota=True,user_id='1d13a1e140844760920871f2e8b22ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9614b127-cbb8-40fa-9b4a-26cd82de3fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9614b127-cbb8-40fa-9b4a-26cd82de3fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6c0cc2-0cdf-4fbe-8770-cd8c027c6e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6c0cc2-0cdf-4fbe-8770-cd8c027c6e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfcf7d9-811f-4df1-a5af-1ea5485334bb', 'volume_name': 'volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42e601b-b88a-40da-8e52-85f7ad13c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42e601b-b88a-40da-8e52-85f7ad13c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ceebf0c-af28-4549-8e3e-ae4c10f0c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:20 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Volume cdfcf7d9-811f-4df1-a5af-1ea5485334bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb', 'volume_size': 1}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-950478648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfcf7d9-811f-4df1-a5af-1ea5485334bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e14f92234c4126b0806aab368eab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:20Z,use_quota=True,user_id='1d13a1e140844760920871f2e8b22ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Creating volume cdfcf7d9-811f-4df1-a5af-1ea5485334bb {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:34:20 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:20 devstack quobyte-client[82407]: System call of process 96982 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:34:20 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=124, name=volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb 1073741824" returned: 0 in 0.307s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] <== create_volume: return (447ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.460s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ceebf0c-af28-4549-8e3e-ae4c10f0c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f5b1a5-c635-4235-b5eb-2ebdd6f47342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:21 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Volume volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb (cdfcf7d9-811f-4df1-a5af-1ea5485334bb): created successfully
Sep 03 08:34:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f5b1a5-c635-4235-b5eb-2ebdd6f47342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Flow 'volume_create_manager' (8256a8b3-402f-4031-b7b7-68c3531a1f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:21 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f843162a-a55f-45ce-be2a-c4b0fc3472fa tempest-VolumesTransfersV355Test-1596435328 None] Created volume successfully.
Sep 03 08:34:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-65c1667b-55c2-4cbe-af76-d85e3cbaa629 tempest-VolumesTransfersV355Test-288417750 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:22 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-65c1667b-55c2-4cbe-af76-d85e3cbaa629 tempest-VolumesTransfersV355Test-288417750 None] Transfer volume completed successfully.
Sep 03 08:34:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Acquiring lock "cinder-cdfcf7d9-811f-4df1-a5af-1ea5485334bb-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-cdfcf7d9-811f-4df1-a5af-1ea5485334bb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Acquiring lock "cinder-quobyte-cdfcf7d9-811f-4df1-a5af-1ea5485334bb" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:23 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-quobyte-cdfcf7d9-811f-4df1-a5af-1ea5485334bb" acquired by "delete_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:23 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241fd85-7621-463f-9c11-3a117119618c]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:34:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb" returned: 0 in 0.397s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-cdfcf7d9-811f-4df1-a5af-1ea5485334bb" returned: 0 in 0.106s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-quobyte-cdfcf7d9-811f-4df1-a5af-1ea5485334bb" released by "delete_volume" :: held 0.635s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Created reservations ['4a29a182-83f1-4d2d-9638-4c27e1e64d09', '59c4092b-ceb9-4493-9b62-ed83091c5566', '7fb79a3c-eb04-4de0-9ea2-cc5ac34a3dd7', '84e190cb-b773-41fa-87bb-7ed6e5ee17e7'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.235s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:24 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:34:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Deleted volume successfully.
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-10919256-3eb3-4e06-b09e-f54ef171ffab tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-cdfcf7d9-811f-4df1-a5af-1ea5485334bb-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Flow 'volume_create_manager' (e7579edc-794f-4462-a601-1b092bdd3840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ec7937-4e56-411f-9978-4ecf0799e9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ec7937-4e56-411f-9978-4ecf0799e9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-585347393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64dd1d6-375f-486e-a887-afb89f8e1ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e14f92234c4126b0806aab368eab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:25Z,use_quota=True,user_id='1d13a1e140844760920871f2e8b22ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a0e8d1-b687-41f5-b04d-012a4e648088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a0e8d1-b687-41f5-b04d-012a4e648088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f33890a-5400-4eb0-95a2-005a8dbf4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f33890a-5400-4eb0-95a2-005a8dbf4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64dd1d6-375f-486e-a887-afb89f8e1ba8', 'volume_name': 'volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa6ce45-c30a-4c2c-9d8c-423dc7a15357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa6ce45-c30a-4c2c-9d8c-423dc7a15357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b195df20-4122-43a4-95a9-35df3d471526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:25 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Volume d64dd1d6-375f-486e-a887-afb89f8e1ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8', 'volume_size': 1}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-585347393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64dd1d6-375f-486e-a887-afb89f8e1ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e14f92234c4126b0806aab368eab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:25Z,use_quota=True,user_id='1d13a1e140844760920871f2e8b22ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Creating volume d64dd1d6-375f-486e-a887-afb89f8e1ba8 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:34:25 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=125, name=volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:34:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8 1073741824" returned: 0 in 0.334s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8" returned: 0 in 0.112s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.515s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b195df20-4122-43a4-95a9-35df3d471526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789197ca-8715-4951-ae1e-07fea128d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Volume volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8 (d64dd1d6-375f-486e-a887-afb89f8e1ba8): created successfully
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789197ca-8715-4951-ae1e-07fea128d91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Flow 'volume_create_manager' (e7579edc-794f-4462-a601-1b092bdd3840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d0885c58-325a-4783-aada-7145504ea518 tempest-VolumesTransfersV355Test-1596435328 None] Created volume successfully.
Sep 03 08:34:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Acquiring lock "cinder-d64dd1d6-375f-486e-a887-afb89f8e1ba8-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-d64dd1d6-375f-486e-a887-afb89f8e1ba8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:27 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Acquiring lock "cinder-quobyte-d64dd1d6-375f-486e-a887-afb89f8e1ba8" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:34:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-quobyte-d64dd1d6-375f-486e-a887-afb89f8e1ba8" acquired by "delete_volume" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:34:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1251e9a-5460-42ce-850f-d853a7d34c7c]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:34:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8" returned: 0 in 0.392s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-d64dd1d6-375f-486e-a887-afb89f8e1ba8" returned: 0 in 0.116s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-quobyte-d64dd1d6-375f-486e-a887-afb89f8e1ba8" released by "delete_volume" :: held 0.653s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:28 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Created reservations ['1579f130-3aca-428a-871b-97c8a59deee7', '038f57ca-dfa7-4b09-b067-ee95fd5b85f7', '3d2f36c2-ef12-4883-a11b-3f8043e8b5fc', '974dfb0e-75d1-485e-aa14-37dea365bab4'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.102s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:34:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Deleted volume successfully.
Sep 03 08:34:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9c463d0b-e2c2-4f1c-b0f2-e987bc6e3aa2 tempest-VolumesTransfersV355Test-1877306032 None] Lock "cinder-d64dd1d6-375f-486e-a887-afb89f8e1ba8-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:34:39 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=43,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:34:39 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=27,cinder:DELETE=4,cinder:INSERT=8,cinder:UPDATE=36 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:34:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Flow 'volume_create_manager' (6d1e8ff6-8de6-4772-824f-778cbe6e3c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1777b92-a5b7-43e1-9c3d-4959fee10789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1777b92-a5b7-43e1-9c3d-4959fee10789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1818103992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646411d5-7a8a-4936-921d-371d25fd52d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e45cf74ffc44a49816529e2486cae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:46Z,use_quota=True,user_id='05be655c71a647a38cf6f89f751237a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b40ac29-fa64-4584-bab3-44fa7b165b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b40ac29-fa64-4584-bab3-44fa7b165b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f90a394-3288-4580-a418-29cbdb223a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f90a394-3288-4580-a418-29cbdb223a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646411d5-7a8a-4936-921d-371d25fd52d4', 'volume_name': 'volume-646411d5-7a8a-4936-921d-371d25fd52d4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c38da20-03b4-4c86-868e-da1e7f0228b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c38da20-03b4-4c86-868e-da1e7f0228b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f138d4-6188-44ba-9079-d43e7d8481a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:46 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Volume 646411d5-7a8a-4936-921d-371d25fd52d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646411d5-7a8a-4936-921d-371d25fd52d4', 'volume_size': 1}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1818103992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646411d5-7a8a-4936-921d-371d25fd52d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e45cf74ffc44a49816529e2486cae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:34:46Z,use_quota=True,user_id='05be655c71a647a38cf6f89f751237a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Creating volume 646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:34:46 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:46 devstack quobyte-client[82407]: System call of process 97010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:34:46 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=126, name=volume-646411d5-7a8a-4936-921d-371d25fd52d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 1073741824" returned: 0 in 0.318s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.078s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:47 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] <== create_volume: return (455ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:34:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.466s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f138d4-6188-44ba-9079-d43e7d8481a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646411d5-7a8a-4936-921d-371d25fd52d4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2871e-e18b-4169-a84a-aa7354e8fa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:34:47 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Volume volume-646411d5-7a8a-4936-921d-371d25fd52d4 (646411d5-7a8a-4936-921d-371d25fd52d4): created successfully
Sep 03 08:34:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2871e-e18b-4169-a84a-aa7354e8fa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:34:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Flow 'volume_create_manager' (6d1e8ff6-8de6-4772-824f-778cbe6e3c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:34:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5f8a0983-1ebd-4709-8c5a-a7faa86726c4 tempest-VolumesActionsTest-447131746 None] Created volume successfully.
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.096s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:34:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:35:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:35:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:35:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5939fdc7-5e35-4c3c-8e72-9b63d87ce339 tempest-VolumesActionsTest-447131746 None] Acquiring lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4" by "attach_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:35:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5939fdc7-5e35-4c3c-8e72-9b63d87ce339 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4" acquired by "attach_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:35:12 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5939fdc7-5e35-4c3c-8e72-9b63d87ce339 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:35:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5939fdc7-5e35-4c3c-8e72-9b63d87ce339 tempest-VolumesActionsTest-447131746 None] Attaching volume 646411d5-7a8a-4936-921d-371d25fd52d4 to instance 4f035e89-599e-4a16-851a-40aa0b081cea at mountpoint /dev/vdb on host None.
Sep 03 08:35:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5939fdc7-5e35-4c3c-8e72-9b63d87ce339 tempest-VolumesActionsTest-447131746 None] Attach volume completed successfully.
Sep 03 08:35:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-5939fdc7-5e35-4c3c-8e72-9b63d87ce339 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4" released by "attach_volume" :: held 0.213s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:35:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-009daf64-8e17-46f0-ae75-d61ea97b3b55 tempest-VolumesActionsTest-447131746 None] Acquiring lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-detach_volume" by "detach_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:35:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-009daf64-8e17-46f0-ae75-d61ea97b3b55 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:35:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-009daf64-8e17-46f0-ae75-d61ea97b3b55 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:35:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-009daf64-8e17-46f0-ae75-d61ea97b3b55 tempest-VolumesActionsTest-447131746 None] Detaching volume 646411d5-7a8a-4936-921d-371d25fd52d4 from instance 4f035e89-599e-4a16-851a-40aa0b081cea.
Sep 03 08:35:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-009daf64-8e17-46f0-ae75-d61ea97b3b55 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:35:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-009daf64-8e17-46f0-ae75-d61ea97b3b55 tempest-VolumesActionsTest-447131746 None] Detach volume completed successfully.
Sep 03 08:35:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-009daf64-8e17-46f0-ae75-d61ea97b3b55 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:35:23 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:35:23 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:INSERT=2,cinder:UPDATE=3,cinder:SELECT=6 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:35:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c0d69d89-6c99-4acd-9f11-44a0f27148db tempest-VolumesActionsTest-447131746 None] Acquiring lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4" by "attach_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:35:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c0d69d89-6c99-4acd-9f11-44a0f27148db tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4" acquired by "attach_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:35:43 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c0d69d89-6c99-4acd-9f11-44a0f27148db tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:35:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c0d69d89-6c99-4acd-9f11-44a0f27148db tempest-VolumesActionsTest-447131746 None] Attaching volume 646411d5-7a8a-4936-921d-371d25fd52d4 to instance 0e173a0d-2a44-4abe-8054-20064392fb39 at mountpoint /dev/vdb on host None.
Sep 03 08:35:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c0d69d89-6c99-4acd-9f11-44a0f27148db tempest-VolumesActionsTest-447131746 None] Attach volume completed successfully.
Sep 03 08:35:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c0d69d89-6c99-4acd-9f11-44a0f27148db tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4" released by "attach_volume" :: held 0.162s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:35:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-09f5acf0-8804-40e9-933c-1cd2f0d35e41 tempest-VolumesActionsTest-447131746 None] Acquiring lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-detach_volume" by "detach_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:35:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-09f5acf0-8804-40e9-933c-1cd2f0d35e41 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:35:44 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-09f5acf0-8804-40e9-933c-1cd2f0d35e41 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:35:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-09f5acf0-8804-40e9-933c-1cd2f0d35e41 tempest-VolumesActionsTest-447131746 None] Detaching volume 646411d5-7a8a-4936-921d-371d25fd52d4 from instance 0e173a0d-2a44-4abe-8054-20064392fb39.
Sep 03 08:35:44 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-09f5acf0-8804-40e9-933c-1cd2f0d35e41 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:35:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-09f5acf0-8804-40e9-933c-1cd2f0d35e41 tempest-VolumesActionsTest-447131746 None] Detach volume completed successfully.
Sep 03 08:35:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-09f5acf0-8804-40e9-933c-1cd2f0d35e41 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:35:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:35:54 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:35:54 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:35:54 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:35:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:35:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:35:54 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341d22d-eb25-4c41-83e9-cbb4c72fd925]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:35:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:35:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.421s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:35:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e37dafc-ad1a-48b1-80aa-21f4f06aa826]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:35:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:35:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.394s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:35:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.e4395f7d-8819-403d-9bb8-fec92d07f2c4d3wfd0zm.img {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.e4395f7d-8819-403d-9bb8-fec92d07f2c4d3wfd0zm.img" returned: 0 in 6.053s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:01 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[074adf61-fcb9-4d9c-b90b-dea9a2283466]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:36:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.499s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:02 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.e4395f7d-8819-403d-9bb8-fec92d07f2c4d3wfd0zm.img {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:36:02 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Converted 1024.00 MB image at 168.67 MB/s
Sep 03 08:36:02 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] e4395f7d-8819-403d-9bb8-fec92d07f2c4 was raw, no need to convert to raw {{(pid=82397) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 03 08:36:04 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:36:12 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:36:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 45.717s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:36:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Uploaded volume to glance image-id: e4395f7d-8819-403d-9bb8-fec92d07f2c4. {{(pid=82397) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 03 08:36:40 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-dc108db5-1a74-49a3-8d96-0946bf169794 tempest-VolumesActionsTest-447131746 None] Copy volume to image completed successfully.
Sep 03 08:36:42 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb164612-0d6b-406e-81a3-204296c03cce]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.381s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddf1fa4-b04e-4519-8586-c1e3a7d9ce5b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.371s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img" returned: 0 in 5.602s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f570efd-fcbe-4b4a-8042-6578f3bc801a]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.100s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:36:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.581s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:49 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:36:49 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Converted 1024.00 MB image at 182.04 MB/s
Sep 03 08:36:49 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] 94235b47-7a3b-4156-a08c-53643ecd0d65 was raw, converting to qcow2 {{(pid=82397) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 03 08:36:49 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b423da5-e4ba-4824-a240-2ae12040946d]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:36:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img" returned: 0 in 0.357s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img" returned: 1 in 0.318s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img /opt/stack/data/cinder/conversion/vol_upload_7von6_zo {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img /opt/stack/data/cinder/conversion/vol_upload_7von6_zo" returned: 0 in 0.125s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Image conversion details: src /opt/stack/data/cinder/conversion/646411d5-7a8a-4936-921d-371d25fd52d4.temp_image.94235b47-7a3b-4156-a08c-53643ecd0d653t2ilxzq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7von6_zo {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:36:50 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd068270-aa0a-4d61-8870-0554dc74065f]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7von6_zo {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7von6_zo" returned: 0 in 0.344s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.696s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:36:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Uploaded volume to glance image-id: 94235b47-7a3b-4156-a08c-53643ecd0d65. {{(pid=82397) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 03 08:36:51 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-1dee9947-63d3-48d0-a1ed-3a140948c3b4 tempest-VolumesActionsTest-447131746 None] Copy volume to image completed successfully.
Sep 03 08:36:53 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Acquiring lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:36:53 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:36:53 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:36:53 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Acquiring lock "cinder-quobyte-646411d5-7a8a-4936-921d-371d25fd52d4" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:36:53 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Lock "cinder-quobyte-646411d5-7a8a-4936-921d-371d25fd52d4" acquired by "delete_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:36:53 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebf7f26-6b01-4a89-ac3f-b353d26e2fbc]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:36:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.383s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-646411d5-7a8a-4936-921d-371d25fd52d4" returned: 0 in 0.100s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Lock "cinder-quobyte-646411d5-7a8a-4936-921d-371d25fd52d4" released by "delete_volume" :: held 0.599s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Created reservations ['9d6133f7-c1d6-4c2d-a26c-0dacefc975fd', '3486ba36-8263-428e-aaed-cec4f6305fbb', 'b52ebedb-b769-49e8-b764-0cab4b34a67c', '02c10bd8-6fa9-4842-b6b3-9ed50321a7a8'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.124s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:36:54 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:36:54 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Deleted volume successfully.
Sep 03 08:36:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14cd2a1d-e9a9-48fc-8389-7bd7b9ab0890 tempest-VolumesActionsTest-447131746 None] Lock "cinder-646411d5-7a8a-4936-921d-371d25fd52d4-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:37:04 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:37:04 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:37:24 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Flow 'volume_create_manager' (79538b98-f13d-4a05-a3d7-e668e882eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6fb2f0-6454-4d3a-be05-a6b1a3e1b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6fb2f0-6454-4d3a-be05-a6b1a3e1b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1923284521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c162503b-5d1c-4443-a5b2-2394fc836a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c021fe071004408a87851eccd9c95e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:37:24Z,use_quota=True,user_id='bb16b60984d74d9cbdb02b05320b2962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c37e6166-9ce7-4a73-b7b9-4ccab98432f8),volume_type_id=c37e6166-9ce7-4a73-b7b9-4ccab98432f8)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567f6fec-bd72-4bb9-9e1b-200ea7ab8726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567f6fec-bd72-4bb9-9e1b-200ea7ab8726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0681877-f425-4d8f-b516-94e6c4897fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0681877-f425-4d8f-b516-94e6c4897fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c162503b-5d1c-4443-a5b2-2394fc836a2d', 'volume_name': 'volume-c162503b-5d1c-4443-a5b2-2394fc836a2d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6319a5-5efe-49d8-acfd-32fde755c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6319a5-5efe-49d8-acfd-32fde755c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc5028b-1fe6-445e-9cda-7c4e1c9f5d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume c162503b-5d1c-4443-a5b2-2394fc836a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c162503b-5d1c-4443-a5b2-2394fc836a2d', 'volume_size': 1}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1923284521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c162503b-5d1c-4443-a5b2-2394fc836a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c021fe071004408a87851eccd9c95e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:37:24Z,use_quota=True,user_id='bb16b60984d74d9cbdb02b05320b2962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c37e6166-9ce7-4a73-b7b9-4ccab98432f8),volume_type_id=c37e6166-9ce7-4a73-b7b9-4ccab98432f8)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Creating volume c162503b-5d1c-4443-a5b2-2394fc836a2d {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:37:24 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:37:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:24 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=127, name=volume-c162503b-5d1c-4443-a5b2-2394fc836a2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d 1073741824" returned: 0 in 0.506s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Flow 'volume_create_manager' (bce27142-2483-4cb6-a20f-59c2ced37906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2b576f-d330-4d39-a0bb-edfb4fe97b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d" returned: 0 in 0.514s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] <== create_volume: return (1050ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2b576f-d330-4d39-a0bb-edfb4fe97b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2092036386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0cb511-a9cc-49d6-8706-b7adad2ce7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c021fe071004408a87851eccd9c95e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:37:25Z,use_quota=True,user_id='bb16b60984d74d9cbdb02b05320b2962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e13c575a-5973-44e7-a6e3-16f0ca86457a),volume_type_id=e13c575a-5973-44e7-a6e3-16f0ca86457a)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9d5bf5-bcac-48a2-9693-7b58bc09c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9d5bf5-bcac-48a2-9693-7b58bc09c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f9affa-666a-4b02-bcda-082d72630c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f9affa-666a-4b02-bcda-082d72630c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0cb511-a9cc-49d6-8706-b7adad2ce7a7', 'volume_name': 'volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598dbbeb-a6da-4f01-b3ca-7cb6cc22494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598dbbeb-a6da-4f01-b3ca-7cb6cc22494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f5dbf9-b7b6-4e59-b3f3-3f92933e5793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:25 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume 8e0cb511-a9cc-49d6-8706-b7adad2ce7a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7', 'volume_size': 1}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2092036386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0cb511-a9cc-49d6-8706-b7adad2ce7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c021fe071004408a87851eccd9c95e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:37:25Z,use_quota=True,user_id='bb16b60984d74d9cbdb02b05320b2962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e13c575a-5973-44e7-a6e3-16f0ca86457a),volume_type_id=e13c575a-5973-44e7-a6e3-16f0ca86457a)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Creating volume 8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:37:25 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=128, name=volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:37:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:37:25 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Flow 'volume_create_manager' (488bec8e-e7e0-48ae-a38d-db05d3e82022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81599bb5-93e4-432e-9bff-7c20a86f5133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc5028b-1fe6-445e-9cda-7c4e1c9f5d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c162503b-5d1c-4443-a5b2-2394fc836a2d', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d81693-97d7-4b40-a7c9-92bdedc04a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81599bb5-93e4-432e-9bff-7c20a86f5133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-664720695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4514684-f152-40c7-b234-56109867947b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c021fe071004408a87851eccd9c95e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:37:25Z,use_quota=True,user_id='bb16b60984d74d9cbdb02b05320b2962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b84f2b4b-d72a-4a7e-bae6-4e751569ec66),volume_type_id=b84f2b4b-d72a-4a7e-bae6-4e751569ec66)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44540a-daa5-4089-8371-02db8f8b5123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44540a-daa5-4089-8371-02db8f8b5123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdea3e1-8063-4752-853f-df44c34c27db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 1073741824" returned: 0 in 0.614s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume volume-c162503b-5d1c-4443-a5b2-2394fc836a2d (c162503b-5d1c-4443-a5b2-2394fc836a2d): created successfully
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d81693-97d7-4b40-a7c9-92bdedc04a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Flow 'volume_create_manager' (79538b98-f13d-4a05-a3d7-e668e882eac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7" returned: 0 in 0.401s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] <== create_volume: return (1050ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-74f9be88-8aa8-4404-9f85-65954473bb9d tempest-TestInstancesWithCinderVolumes-1619292407 None] Created volume successfully.
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f5dbf9-b7b6-4e59-b3f3-3f92933e5793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b700a914-29cb-4e93-8c33-90bf5380581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 (8e0cb511-a9cc-49d6-8706-b7adad2ce7a7): created successfully
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b700a914-29cb-4e93-8c33-90bf5380581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Flow 'volume_create_manager' (bce27142-2483-4cb6-a20f-59c2ced37906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdea3e1-8063-4752-853f-df44c34c27db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4514684-f152-40c7-b234-56109867947b', 'volume_name': 'volume-c4514684-f152-40c7-b234-56109867947b', 'volume_size': 1, 'image_id': 'f1b250db-aff3-4296-87be-079cf799f1be', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1253038618', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c021fe071004408a87851eccd9c95e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f1b250db-aff3-4296-87be-079cf799f1be', 'created_at': datetime.datetime(2025, 9, 3, 6, 37, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1b250db-aff3-4296-87be-079cf799f1be/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b68feb0a0>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8ec2de-68d3-4959-9caf-5bb9ee67e396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8ec2de-68d3-4959-9caf-5bb9ee67e396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b504f217-96d4-4edf-ada9-05f9d9f471e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume c4514684-f152-40c7-b234-56109867947b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4514684-f152-40c7-b234-56109867947b', 'volume_size': 1, 'image_id': 'f1b250db-aff3-4296-87be-079cf799f1be', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1253038618', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c021fe071004408a87851eccd9c95e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f1b250db-aff3-4296-87be-079cf799f1be', 'created_at': datetime.datetime(2025, 9, 3, 6, 37, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1b250db-aff3-4296-87be-079cf799f1be/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b68feb0a0>}
Sep 03 08:37:26 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Cloning c4514684-f152-40c7-b234-56109867947b from image f1b250db-aff3-4296-87be-079cf799f1be  at location (None, None). {{(pid=82397) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}}
Sep 03 08:37:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d98da526-74a4-4e5d-9867-4e72050eb60a tempest-TestInstancesWithCinderVolumes-1619292407 None] Created volume successfully.
Sep 03 08:37:28 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD, size 20.69 MB, duration 1.29 sec {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 03 08:37:28 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Image download 20.69 MB at 15.98 MB/s
Sep 03 08:37:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b967b026-748c-4273-bbf7-c9417a13feaa]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:37:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:28 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD
Sep 03 08:37:28 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:37:30 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Sep 03 08:37:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD" returned: 0 in 2.021s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:30 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Temporary image f1b250db-aff3-4296-87be-079cf799f1be is fetched for user bb16b60984d74d9cbdb02b05320b2962. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 03 08:37:30 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11515c5-408d-4b59-b514-38f55424283b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:37:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:31 devstack sudo[97503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD
Sep 03 08:37:31 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:37:32 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD" returned: 0 in 1.824s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-664720695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4514684-f152-40c7-b234-56109867947b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c021fe071004408a87851eccd9c95e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:37:25Z,use_quota=True,user_id='bb16b60984d74d9cbdb02b05320b2962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b84f2b4b-d72a-4a7e-bae6-4e751569ec66),volume_type_id=b84f2b4b-d72a-4a7e-bae6-4e751569ec66)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Creating volume c4514684-f152-40c7-b234-56109867947b {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:37:32 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:37:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:32 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=129, name=volume-c4514684-f152-40c7-b234-56109867947b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b 1073741824" returned: 0 in 0.347s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] <== create_volume: return (505ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.538s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Attempting download of f1b250db-aff3-4296-87be-079cf799f1be ((None, None)) to volume c4514684-f152-40c7-b234-56109867947b. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[d878d76c-0732-476e-87be-2d1bcc2c8aa7]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1b250db-aff3-4296-87be-079cf799f1be_f76mnlyd {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1b250db-aff3-4296-87be-079cf799f1be_f76mnlyd" returned: 0 in 0.349s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1b250db-aff3-4296-87be-079cf799f1be_f76mnlyd {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1b250db-aff3-4296-87be-079cf799f1be_f76mnlyd" returned: 1 in 0.387s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1b250db-aff3-4296-87be-079cf799f1be_f76mnlyd' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:37:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[db597e46-3248-4ad8-b9ce-76c6f99bb5bb]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:37:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:34 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] f1b250db-aff3-4296-87be-079cf799f1be was qcow2, converting to raw {{(pid=82397) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 03 08:37:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:34 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=129, name=volume-c4514684-f152-40c7-b234-56109867947b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:37:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 0 in 0.958s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:35 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f1b250db-aff3-4296-87be-079cf799f1be_6z906gp6devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:37:35 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Converted 112.00 MB image at 112.00 MB/s
Sep 03 08:37:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:35 devstack quobyte-client[82407]: System call of process 97526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b 1G" returned: 0 in 0.131s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1feb74-71db-4788-a22d-5af1e85c267a]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 0 in 0.353s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 1 in 0.379s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Downloaded image f1b250db-aff3-4296-87be-079cf799f1be ((None, None)) to volume c4514684-f152-40c7-b234-56109867947b successfully. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Temporary image f1b250db-aff3-4296-87be-079cf799f1be for user bb16b60984d74d9cbdb02b05320b2962 is deleted. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 03 08:37:36 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Marking volume c4514684-f152-40c7-b234-56109867947b as bootable. {{(pid=82397) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 03 08:37:37 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Copying metadata from image f1b250db-aff3-4296-87be-079cf799f1be to c4514684-f152-40c7-b234-56109867947b. {{(pid=82397) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 03 08:37:37 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Creating volume glance metadata for volume c4514684-f152-40c7-b234-56109867947b backed by image f1b250db-aff3-4296-87be-079cf799f1be with: {'image_id': 'f1b250db-aff3-4296-87be-079cf799f1be', 'image_name': 'tempest-scenario-img--1253038618', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82397) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 03 08:37:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b504f217-96d4-4edf-ada9-05f9d9f471e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4514684-f152-40c7-b234-56109867947b', 'volume_size': 1, 'image_id': 'f1b250db-aff3-4296-87be-079cf799f1be', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1253038618', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c021fe071004408a87851eccd9c95e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f1b250db-aff3-4296-87be-079cf799f1be', 'created_at': datetime.datetime(2025, 9, 3, 6, 37, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 37, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1b250db-aff3-4296-87be-079cf799f1be/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b68feb0a0>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979fe1a2-4986-40f8-b880-645772d79d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:37:37 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume volume-c4514684-f152-40c7-b234-56109867947b (c4514684-f152-40c7-b234-56109867947b): created successfully
Sep 03 08:37:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979fe1a2-4986-40f8-b880-645772d79d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:37:37 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Flow 'volume_create_manager' (488bec8e-e7e0-48ae-a38d-db05d3e82022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:37:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-02fad7ea-adaf-46ec-ba62-7d72fe378ff4 tempest-TestInstancesWithCinderVolumes-1619292407 None] Created volume successfully.
Sep 03 08:37:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79cdab4-5985-4709-857b-5158afb36243]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:37:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 0 in 0.388s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 1 in 0.376s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:37:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:46 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-c4514684-f152-40c7-b234-56109867947b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70e08d1b-9689-466e-a2a0-ade5718c475e', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:37:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:37:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-06377d4a-b02a-4a91-b306-c4015fc459cb req-aaa7ec68-a523-4d05-9314-367bd0dd134d tempest-TestInstancesWithCinderVolumes-1619292407 None] attachment_update completed successfully.
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.147s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:37:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:37:57 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=13,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:37:57 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=5 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.095s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:38:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:39:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:39:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:39:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:39:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:39:01 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd168e6d-f009-4093-a4d1-7d6acd529e41]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:39:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:39:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d" returned: 0 in 0.572s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:39:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.647s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:39:02 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-c162503b-5d1c-4443-a5b2-2394fc836a2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36ae18e5-2232-469d-b70f-056dc21a63e2', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:39:02 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:39:02 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-5bc5e66f-ceb7-4093-a74e-621199770898 req-a76b73e7-60fd-4167-8c5a-90b216ed8611 tempest-TestInstancesWithCinderVolumes-1619292407 None] attachment_update completed successfully.
Sep 03 08:39:12 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:39:12 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:39:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:39:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:39:12 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced98283-997d-48d7-94bc-b78e37704a1c]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:39:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:39:13 devstack quobyte-client[82407]: System call of process 98196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:39:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7" returned: 0 in 0.400s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:39:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.453s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:39:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20d9fb41-454e-4e15-bca0-851599db92a6', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:39:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:39:13 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-988b2ccd-8023-447a-a54e-6c240efe6954 req-58bd4f05-96d6-4a43-9aed-a841e0423ca1 tempest-TestInstancesWithCinderVolumes-1619292407 None] attachment_update completed successfully.
Sep 03 08:39:23 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:39:23 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=8 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:39:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-da58d8a2-0fad-4fc5-b96e-19fc39f88f4f req-f1355c14-cfe2-49d9-b0ee-6c3366f9d11d tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:39:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-da58d8a2-0fad-4fc5-b96e-19fc39f88f4f req-f1355c14-cfe2-49d9-b0ee-6c3366f9d11d tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:39:47 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-da58d8a2-0fad-4fc5-b96e-19fc39f88f4f req-f1355c14-cfe2-49d9-b0ee-6c3366f9d11d tempest-TestInstancesWithCinderVolumes-1619292407 None] Terminate volume connection completed successfully.
Sep 03 08:39:47 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-da58d8a2-0fad-4fc5-b96e-19fc39f88f4f req-f1355c14-cfe2-49d9-b0ee-6c3366f9d11d tempest-TestInstancesWithCinderVolumes-1619292407 None] Deleting attachment 36ae18e5-2232-469d-b70f-056dc21a63e2. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "cinder-c162503b-5d1c-4443-a5b2-2394fc836a2d-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-c162503b-5d1c-4443-a5b2-2394fc836a2d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:39:48 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "cinder-quobyte-c162503b-5d1c-4443-a5b2-2394fc836a2d" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-quobyte-c162503b-5d1c-4443-a5b2-2394fc836a2d" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa985c-765d-4438-950d-e728f9539774]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:39:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:39:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.239s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:39:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:39:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d" returned: 0 in 0.554s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:39:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:39:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c162503b-5d1c-4443-a5b2-2394fc836a2d" returned: 0 in 0.100s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:39:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-quobyte-c162503b-5d1c-4443-a5b2-2394fc836a2d" released by "delete_volume" :: held 0.960s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:39:49 devstack cinder-volume[82397]: WARNING cinder.quota [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024105460-978644341 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024105460-978644341, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:39:49 devstack cinder-volume[82397]: WARNING cinder.quota [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024105460-978644341 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024105460-978644341, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Created reservations ['9d42083a-b6da-47b3-bd50-bc606685a8a2', '1623f9c9-ec47-4a7b-b34c-562662c2486d', 'fe9da847-af80-4c6b-a2e8-1b91082af8ad', '23e11441-8e13-42f0-aa12-459b1b363b91'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.097s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:39:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Deleted volume successfully.
Sep 03 08:39:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-306d8390-4e8d-4ce2-94d3-2aef621ba297 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-c162503b-5d1c-4443-a5b2-2394fc836a2d-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:40:00 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:40:00 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:40:17 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-15056c13-404d-4f28-bf7c-899b324523b2 req-9f35c422-fcb0-4116-aa91-7319f97edbee tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:40:17 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-15056c13-404d-4f28-bf7c-899b324523b2 req-9f35c422-fcb0-4116-aa91-7319f97edbee tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:40:17 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-15056c13-404d-4f28-bf7c-899b324523b2 req-9f35c422-fcb0-4116-aa91-7319f97edbee tempest-TestInstancesWithCinderVolumes-1619292407 None] Terminate volume connection completed successfully.
Sep 03 08:40:17 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-15056c13-404d-4f28-bf7c-899b324523b2 req-9f35c422-fcb0-4116-aa91-7319f97edbee tempest-TestInstancesWithCinderVolumes-1619292407 None] Deleting attachment 20d9fb41-454e-4e15-bca0-851599db92a6. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "cinder-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:40:19 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "cinder-quobyte-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-quobyte-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7" acquired by "delete_volume" :: waited 0.017s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[998fa864-12bc-493d-a38b-62ba8a71dbe4]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7" returned: 0 in 0.465s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7" returned: 0 in 0.104s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-quobyte-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7" released by "delete_volume" :: held 0.750s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:40:20 devstack cinder-volume[82397]: WARNING cinder.quota [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139412281-1817397123 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139412281-1817397123, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:40:20 devstack cinder-volume[82397]: WARNING cinder.quota [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139412281-1817397123 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139412281-1817397123, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Created reservations ['ea96b357-9374-40ab-9d87-732bd8315d67', '874d3a7a-79fb-4df1-a8d5-f812af941936', '132b1749-f4b5-4e99-bfb6-185874a4f947', '1d6edc08-6dd9-40e5-a50c-b902a492511c'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.152s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:20 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:40:20 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Deleted volume successfully.
Sep 03 08:40:21 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-dc1498f6-ed02-4394-acae-c3c94a7b909f tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-8e0cb511-a9cc-49d6-8706-b7adad2ce7a7-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:40:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-08f1d988-649a-4f6a-8521-d9795645c811 req-f773833b-5b46-4778-ab36-5ae393473472 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:40:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-08f1d988-649a-4f6a-8521-d9795645c811 req-f773833b-5b46-4778-ab36-5ae393473472 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:40:28 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-08f1d988-649a-4f6a-8521-d9795645c811 req-f773833b-5b46-4778-ab36-5ae393473472 tempest-TestInstancesWithCinderVolumes-1619292407 None] Terminate volume connection completed successfully.
Sep 03 08:40:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-08f1d988-649a-4f6a-8521-d9795645c811 req-f773833b-5b46-4778-ab36-5ae393473472 tempest-TestInstancesWithCinderVolumes-1619292407 None] Deleting attachment 70e08d1b-9689-466e-a2a0-ade5718c475e. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:40:31 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:40:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "cinder-c4514684-f152-40c7-b234-56109867947b-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:40:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-c4514684-f152-40c7-b234-56109867947b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:40:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:40:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "cinder-quobyte-c4514684-f152-40c7-b234-56109867947b" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:40:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-quobyte-c4514684-f152-40c7-b234-56109867947b" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:40:32 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de27116-0e2c-4c28-be07-cb644c6d36d5]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:40:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 0 in 0.379s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 1 in 0.363s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:40:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c4514684-f152-40c7-b234-56109867947b" returned: 0 in 0.112s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-quobyte-c4514684-f152-40c7-b234-56109867947b" released by "delete_volume" :: held 1.090s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:40:33 devstack cinder-volume[82397]: WARNING cinder.quota [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-271661181-552239798 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-271661181-552239798, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:40:33 devstack cinder-volume[82397]: WARNING cinder.quota [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-271661181-552239798 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-271661181-552239798, it is now deprecated. Please use the default quota class for default quota.
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Created reservations ['194a70fb-e79c-4421-9377-f474d7a1b0a6', '50d75d0a-0e52-4934-b37c-d9702f03177c', '09857f60-a57e-4455-a922-501963ae6394', '01e437ff-0634-44bd-88c9-a31457b5d249'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.088s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:40:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Deleted volume successfully.
Sep 03 08:40:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a1069cde-d2ad-4e30-b786-7fb3d54237a5 tempest-TestInstancesWithCinderVolumes-1619292407 None] Lock "cinder-c4514684-f152-40c7-b234-56109867947b-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:40:44 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=14 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:40:44 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.123s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:40:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:41:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:41:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:41:41 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Flow 'volume_create_manager' (dd916e7c-4e78-4a22-8747-ea9c1cbb734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4609d539-3220-447b-abbc-6fc5b4316e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4609d539-3220-447b-abbc-6fc5b4316e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-115729135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b3859e-6eac-4416-910b-ce23a29e982b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c596f2b80143a68475532651a61a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:41:42Z,use_quota=True,user_id='bda2edb7d16d458ea9fdebfe60598d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08d106a-f054-452d-8fe6-366615c92195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08d106a-f054-452d-8fe6-366615c92195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06738d8-54b7-4355-8925-043b859d03c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06738d8-54b7-4355-8925-043b859d03c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b3859e-6eac-4416-910b-ce23a29e982b', 'volume_name': 'volume-b2b3859e-6eac-4416-910b-ce23a29e982b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229d768-2cfb-4dd5-ab56-527a09129b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f229d768-2cfb-4dd5-ab56-527a09129b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8fd4d6-be64-4710-bedc-8e208d1f60b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:41:41 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Volume b2b3859e-6eac-4416-910b-ce23a29e982b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b3859e-6eac-4416-910b-ce23a29e982b', 'volume_size': 1}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-115729135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b3859e-6eac-4416-910b-ce23a29e982b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c596f2b80143a68475532651a61a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:41:42Z,use_quota=True,user_id='bda2edb7d16d458ea9fdebfe60598d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Creating volume b2b3859e-6eac-4416-910b-ce23a29e982b {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:41:41 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:41:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:41:42 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=130, name=volume-b2b3859e-6eac-4416-910b-ce23a29e982b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:41:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b 1073741824" returned: 0 in 0.406s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:41:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:41:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b" returned: 0 in 0.283s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:41:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] <== create_volume: return (850ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:41:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:41:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8fd4d6-be64-4710-bedc-8e208d1f60b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b3859e-6eac-4416-910b-ce23a29e982b', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:41:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5421d7d-c3d9-4e87-870f-145303893451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:41:43 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Volume volume-b2b3859e-6eac-4416-910b-ce23a29e982b (b2b3859e-6eac-4416-910b-ce23a29e982b): created successfully
Sep 03 08:41:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5421d7d-c3d9-4e87-870f-145303893451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:41:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Flow 'volume_create_manager' (dd916e7c-4e78-4a22-8747-ea9c1cbb734e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:41:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cfd94560-8a27-4241-9b2c-0b810591f128 tempest-TestMinimumBasicScenario-901266744 None] Created volume successfully.
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7b254-7770-45fe-9c7f-f53458d3d7e7]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b" returned: 0 in 0.561s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.620s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:41:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:41:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.317s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:41:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:41:49 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-b2b3859e-6eac-4416-910b-ce23a29e982b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56cfc03f-814d-4f6f-94f2-32ed97384b8b', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:41:49 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:41:49 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-670023aa-892c-4dc6-b78e-c6f5cb0330e7 req-277affdd-07b5-4459-925d-f5738b9b5d9b tempest-TestMinimumBasicScenario-901266744 None] attachment_update completed successfully.
Sep 03 08:41:59 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:41:59 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1,cinder:SELECT=6 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:42:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:42:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:42:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:42:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:42:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:42:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:42:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:42:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.186s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:42:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:43:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:43:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:43:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:43:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:43:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:43:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:43:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:43:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:43:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:43:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:43:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:44:24 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-d257a8d5-c537-44e6-93c4-8817c723b75f req-b264a403-ac16-4864-87d6-84c31a6671e8 tempest-TestMinimumBasicScenario-901266744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:44:24 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-d257a8d5-c537-44e6-93c4-8817c723b75f req-b264a403-ac16-4864-87d6-84c31a6671e8 tempest-TestMinimumBasicScenario-901266744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:44:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-d257a8d5-c537-44e6-93c4-8817c723b75f req-b264a403-ac16-4864-87d6-84c31a6671e8 tempest-TestMinimumBasicScenario-901266744 None] Terminate volume connection completed successfully.
Sep 03 08:44:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-d257a8d5-c537-44e6-93c4-8817c723b75f req-b264a403-ac16-4864-87d6-84c31a6671e8 tempest-TestMinimumBasicScenario-901266744 None] Deleting attachment 56cfc03f-814d-4f6f-94f2-32ed97384b8b. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:44:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Acquiring lock "cinder-b2b3859e-6eac-4416-910b-ce23a29e982b-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:44:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Lock "cinder-b2b3859e-6eac-4416-910b-ce23a29e982b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:44:25 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:44:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Acquiring lock "cinder-quobyte-b2b3859e-6eac-4416-910b-ce23a29e982b" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:44:25 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Lock "cinder-quobyte-b2b3859e-6eac-4416-910b-ce23a29e982b" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:44:25 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c7cdeb-d526-4ecf-9241-0ed5dba632aa]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:44:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b" returned: 0 in 0.466s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b2b3859e-6eac-4416-910b-ce23a29e982b" returned: 0 in 0.083s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Lock "cinder-quobyte-b2b3859e-6eac-4416-910b-ce23a29e982b" released by "delete_volume" :: held 0.705s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Created reservations ['674447e0-f259-40d3-a598-09009a1a1057', '67cf6f1b-afc5-4f91-ac6c-940ee0ea6187', 'e3e278e8-2670-4831-8ae2-ed692aa27907', '353326e2-0ea1-4921-bce0-c3946bbaad7e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.078s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:44:26 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:44:26 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Deleted volume successfully.
Sep 03 08:44:27 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7d336bac-3b1d-4774-a6f7-0ae73aca1acc tempest-TestMinimumBasicScenario-901266744 None] Lock "cinder-b2b3859e-6eac-4416-910b-ce23a29e982b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:44:36 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:44:37 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:44:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:44:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:44:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:44:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:44:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:44:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:44:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:44:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.107s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:44:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:45:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:45:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:45:13 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Flow 'volume_create_manager' (4b169d93-6566-44a0-aa95-4d9710df87e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84f8361-aa1c-42e9-a95a-7387b588863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84f8361-aa1c-42e9-a95a-7387b588863d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1263579485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045e9d555d34c1faade74eda53d354e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:45:13Z,use_quota=True,user_id='4edd624233b1420093714b7214103435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aecd5b-3123-49b5-baf6-f33320d9e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aecd5b-3123-49b5-baf6-f33320d9e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46665dd2-b067-48ac-8b21-44f8264c5a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46665dd2-b067-48ac-8b21-44f8264c5a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33', 'volume_name': 'volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0dfeaa-de3c-4aaa-81a4-6b8bce27556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0dfeaa-de3c-4aaa-81a4-6b8bce27556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4fc7a7-38e8-4b70-a074-8ce59393673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:13 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume 8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33', 'volume_size': 1}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1263579485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045e9d555d34c1faade74eda53d354e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:45:13Z,use_quota=True,user_id='4edd624233b1420093714b7214103435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Creating volume 8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:45:13 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:45:13 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:45:13 devstack quobyte-client[82407]: System call of process 99465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:45:13 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=131, name=volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 1073741824" returned: 0 in 0.643s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:45:14 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Flow 'volume_create_manager' (37b75a67-f8d7-4f77-bb48-e4e35fd8cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13d0252-a588-4a6b-914e-bef36a04912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13d0252-a588-4a6b-914e-bef36a04912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1919069282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0594266-100b-429e-8510-29f817ba98e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045e9d555d34c1faade74eda53d354e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:45:14Z,use_quota=True,user_id='4edd624233b1420093714b7214103435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe4664e-4203-48c7-ae63-b601a12c91a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe4664e-4203-48c7-ae63-b601a12c91a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b6bc43-6aa3-443d-ba09-676c436b0cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b6bc43-6aa3-443d-ba09-676c436b0cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0594266-100b-429e-8510-29f817ba98e5', 'volume_name': 'volume-b0594266-100b-429e-8510-29f817ba98e5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f83f3f4-c679-4641-8b3c-e36393d92b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f83f3f4-c679-4641-8b3c-e36393d92b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc34156-0626-4bcc-b553-90a7e618b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:14 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume b0594266-100b-429e-8510-29f817ba98e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0594266-100b-429e-8510-29f817ba98e5', 'volume_size': 1}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33" returned: 0 in 0.570s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] <== create_volume: return (1276ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1919069282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0594266-100b-429e-8510-29f817ba98e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045e9d555d34c1faade74eda53d354e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:45:14Z,use_quota=True,user_id='4edd624233b1420093714b7214103435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Creating volume b0594266-100b-429e-8510-29f817ba98e5 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:45:14 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:45:14 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:45:15 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=132, name=volume-b0594266-100b-429e-8510-29f817ba98e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4fc7a7-38e8-4b70-a074-8ce59393673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9738e62d-02d8-42e2-bc0e-0655a91e8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:15 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 (8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33): created successfully
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9738e62d-02d8-42e2-bc0e-0655a91e8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Flow 'volume_create_manager' (4b169d93-6566-44a0-aa95-4d9710df87e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5 1073741824" returned: 0 in 0.532s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:45:15 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d01daf1f-a27b-4d39-aef9-0a0580501ff7 tempest-TestServerVolumeAttachmentScenario-745583331 None] Created volume successfully.
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5" returned: 0 in 0.297s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] <== create_volume: return (849ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc34156-0626-4bcc-b553-90a7e618b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0594266-100b-429e-8510-29f817ba98e5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e6444a-4b42-44bc-8ea5-8e2678b8cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:45:15 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume volume-b0594266-100b-429e-8510-29f817ba98e5 (b0594266-100b-429e-8510-29f817ba98e5): created successfully
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e6444a-4b42-44bc-8ea5-8e2678b8cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:45:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Flow 'volume_create_manager' (37b75a67-f8d7-4f77-bb48-e4e35fd8cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:45:15 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d130925c-f5b7-47f6-9dc9-ce9f7d3bc632 tempest-TestServerVolumeAttachmentScenario-745583331 None] Created volume successfully.
Sep 03 08:45:25 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:45:25 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:45:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:45:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:45:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:45:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:45:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:45:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:45:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:45:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.096s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:45:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:46:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:46:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:46:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:46:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:46:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:46:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:46:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:46:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.134s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:46:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:46:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:46:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:46:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f9875-b094-433a-b759-0e5b9e520896]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:46:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:46:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33" returned: 0 in 0.565s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:46:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.627s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:46:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b0465c4-9e9a-4f7d-8735-8ca57972f6d9', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:46:51 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:46:51 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-2b6a4b8a-a020-4867-bf5d-8ed55c646dcf req-276fdbe8-836e-4514-bf73-64ca33001cb3 tempest-TestServerVolumeAttachmentScenario-745583331 None] attachment_update completed successfully.
Sep 03 08:47:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:47:01 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:47:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:47:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:47:04 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c3e5b2-91e2-467c-8fc4-a67cbad10a0e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:47:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:47:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5" returned: 0 in 0.439s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:47:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.492s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:47:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051', 'name': 'volume-b0594266-100b-429e-8510-29f817ba98e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56274d4a-4143-43e3-a329-f5423556e106', 'enforce_multipath': True} {{(pid=82397) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 03 08:47:05 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:47:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-596b5d5e-045c-4df6-a66a-5d33eaf6fd74 req-691c43f5-82c4-49ae-a689-b632886b187c tempest-TestServerVolumeAttachmentScenario-745583331 None] attachment_update completed successfully.
Sep 03 08:47:15 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:47:15 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:47:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-2cacfbf8-12e2-48f7-8236-be087aeaf7ca req-b4c40e3c-0b69-4bd5-b50c-6cff4416fa1a tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:47:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-2cacfbf8-12e2-48f7-8236-be087aeaf7ca req-b4c40e3c-0b69-4bd5-b50c-6cff4416fa1a tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:47:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-2cacfbf8-12e2-48f7-8236-be087aeaf7ca req-b4c40e3c-0b69-4bd5-b50c-6cff4416fa1a tempest-TestServerVolumeAttachmentScenario-745583331 None] Terminate volume connection completed successfully.
Sep 03 08:47:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-2cacfbf8-12e2-48f7-8236-be087aeaf7ca req-b4c40e3c-0b69-4bd5-b50c-6cff4416fa1a tempest-TestServerVolumeAttachmentScenario-745583331 None] Deleting attachment 56274d4a-4143-43e3-a329-f5423556e106. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:47:42 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:47:42 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:47:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:47:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:47:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:47:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:47:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:47:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:47:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:47:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:47:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:47:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-07702d60-b6a5-4000-a980-4f5e67fd8956 req-52bab71b-ccf0-45eb-a127-0c1952c3757c tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:47:56 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [req-07702d60-b6a5-4000-a980-4f5e67fd8956 req-52bab71b-ccf0-45eb-a127-0c1952c3757c tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:47:56 devstack cinder-volume[82397]: INFO cinder.volume.manager [req-07702d60-b6a5-4000-a980-4f5e67fd8956 req-52bab71b-ccf0-45eb-a127-0c1952c3757c tempest-TestServerVolumeAttachmentScenario-745583331 None] Terminate volume connection completed successfully.
Sep 03 08:47:56 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [req-07702d60-b6a5-4000-a980-4f5e67fd8956 req-52bab71b-ccf0-45eb-a127-0c1952c3757c tempest-TestServerVolumeAttachmentScenario-745583331 None] Deleting attachment 1b0465c4-9e9a-4f7d-8735-8ca57972f6d9. {{(pid=82397) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 03 08:48:06 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=2 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "cinder-b0594266-100b-429e-8510-29f817ba98e5-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-b0594266-100b-429e-8510-29f817ba98e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:09 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "cinder-quobyte-b0594266-100b-429e-8510-29f817ba98e5" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-quobyte-b0594266-100b-429e-8510-29f817ba98e5" acquired by "delete_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf470af-2641-4aca-a645-9e65c7d18200]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5" returned: 0 in 0.424s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b0594266-100b-429e-8510-29f817ba98e5" returned: 0 in 0.103s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:09 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-quobyte-b0594266-100b-429e-8510-29f817ba98e5" released by "delete_volume" :: held 0.677s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Created reservations ['44af056f-5db0-46ee-8ec9-30036d703617', '9706b07d-1b80-4e7a-9de2-e11ae5daa5c5', 'bee669c7-1adc-4893-9125-45da3834e9a6', 'a8924694-31af-4e55-ae08-247022fdcde1'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.190s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:10 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Deleted volume successfully.
Sep 03 08:48:10 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-89448b3d-8f29-4c12-a2f2-15b6f7f82b9e tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-b0594266-100b-429e-8510-29f817ba98e5-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "cinder-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:11 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "cinder-quobyte-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:11 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-quobyte-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33" acquired by "delete_volume" :: waited 0.017s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:11 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa62a41-1dc8-4435-ac52-cca8f880a305]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:11 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33" returned: 0 in 0.393s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33" returned: 0 in 0.079s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-quobyte-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33" released by "delete_volume" :: held 0.615s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Created reservations ['29ac277d-feed-4ed9-b74e-8b68243c4c5a', 'c8df0f68-7094-41b0-87e4-dc021c9ba6d8', '3fc54577-3e4d-4b1b-ac34-a3c4121d7e9d', '007c0858-6507-4533-951e-bb6583cd1a53'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.075s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:12 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:12 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Deleted volume successfully.
Sep 03 08:48:13 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-400f67e5-36b9-4e5d-9907-5865a9abf6fe tempest-TestServerVolumeAttachmentScenario-745583331 None] Lock "cinder-8c6bc33e-b6e7-4729-b8d6-f1f800fdcb33-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:22 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:48:22 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=17,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:48:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:28 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:48:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (24c00ecd-e47a-4bf6-92b0-19eab03bce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba211da9-ce48-4452-85e0-9dc39d017fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba211da9-ce48-4452-85e0-9dc39d017fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-505027350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b1c90-5ea2-4627-9311-1748352819af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:29Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608d0ae7-fd94-4849-aa31-b828db78ed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608d0ae7-fd94-4849-aa31-b828db78ed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65ed63f-58d7-46f5-96a0-3f1944199272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65ed63f-58d7-46f5-96a0-3f1944199272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9b1c90-5ea2-4627-9311-1748352819af', 'volume_name': 'volume-4c9b1c90-5ea2-4627-9311-1748352819af', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b291c94e-4cbd-4e55-bbf1-3dbd416b6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b291c94e-4cbd-4e55-bbf1-3dbd416b6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd89a90-0422-443e-a8ef-18141cc30fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:29 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Volume 4c9b1c90-5ea2-4627-9311-1748352819af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9b1c90-5ea2-4627-9311-1748352819af', 'volume_size': 1}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-505027350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b1c90-5ea2-4627-9311-1748352819af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:29Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Creating volume 4c9b1c90-5ea2-4627-9311-1748352819af {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:48:29 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:29 devstack quobyte-client[82407]: System call of process 100312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:48:29 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=133, name=volume-4c9b1c90-5ea2-4627-9311-1748352819af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af 1073741824" returned: 0 in 0.639s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (81c6cbc3-00de-4a11-8587-8388f523b01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a922413-f73a-44f3-9b73-5816d75f9ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a922413-f73a-44f3-9b73-5816d75f9ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684623299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08e96e-36b3-48fc-9dbe-859fb43a8afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:29Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8177dc-9cd8-4043-8b08-5edf608b94e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8177dc-9cd8-4043-8b08-5edf608b94e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4354d1aa-fbad-40c8-8949-cbd69307fedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4354d1aa-fbad-40c8-8949-cbd69307fedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f08e96e-36b3-48fc-9dbe-859fb43a8afd', 'volume_name': 'volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ae2d80-2661-41dd-845e-d708f2479811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ae2d80-2661-41dd-845e-d708f2479811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82cc25e-f10e-4ad9-b901-60bacf0e78e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:30 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Volume 8f08e96e-36b3-48fc-9dbe-859fb43a8afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd', 'volume_size': 1}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af" returned: 0 in 0.652s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] <== create_volume: return (1320ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.059s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684623299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f08e96e-36b3-48fc-9dbe-859fb43a8afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:29Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Creating volume 8f08e96e-36b3-48fc-9dbe-859fb43a8afd {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:48:30 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:30 devstack quobyte-client[82407]: System call of process 100316 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:48:30 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=134, name=volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:48:30 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (4b0a82fe-a822-4e4b-9276-cc1599e9013b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5b1a47-87b4-4e2e-9d68-57c2b578bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (3e8ab257-89be-4393-89bf-858c14f18031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58311b0d-3c8d-419e-84db-e58fd4dfca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5b1a47-87b4-4e2e-9d68-57c2b578bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672840212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f850533-583a-4293-9961-dc913139de61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:30Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b2c0b8-ff6d-4513-83f4-0e43adc7df11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b2c0b8-ff6d-4513-83f4-0e43adc7df11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1338fa-39d6-4fd1-b6b0-cc919c45dff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1338fa-39d6-4fd1-b6b0-cc919c45dff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f850533-583a-4293-9961-dc913139de61', 'volume_name': 'volume-1f850533-583a-4293-9961-dc913139de61', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817d6143-d607-4664-8289-f4adf8c75d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817d6143-d607-4664-8289-f4adf8c75d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4f835a-f56e-4f12-9bcc-508a15b20803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Volume 1f850533-583a-4293-9961-dc913139de61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f850533-583a-4293-9961-dc913139de61', 'volume_size': 1}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd89a90-0422-443e-a8ef-18141cc30fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9b1c90-5ea2-4627-9311-1748352819af', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c56d54-ea85-4cfb-b00c-328cbb44cd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58311b0d-3c8d-419e-84db-e58fd4dfca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440670941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e48392-40d3-4bf2-8492-6541b825c2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:30Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588fc173-b11c-4b0a-a73a-2470644c5df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588fc173-b11c-4b0a-a73a-2470644c5df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169f2f6e-f701-43c6-a386-46e3c0b5195f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169f2f6e-f701-43c6-a386-46e3c0b5195f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e48392-40d3-4bf2-8492-6541b825c2f1', 'volume_name': 'volume-a8e48392-40d3-4bf2-8492-6541b825c2f1', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9020399-de1b-4380-8049-ca0591ee83da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9020399-de1b-4380-8049-ca0591ee83da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073d3b58-3c8e-4a12-a20e-18956b43b7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Volume a8e48392-40d3-4bf2-8492-6541b825c2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e48392-40d3-4bf2-8492-6541b825c2f1', 'volume_size': 1}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd 1073741824" returned: 0 in 0.812s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Volume volume-4c9b1c90-5ea2-4627-9311-1748352819af (4c9b1c90-5ea2-4627-9311-1748352819af): created successfully
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c56d54-ea85-4cfb-b00c-328cbb44cd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (24c00ecd-e47a-4bf6-92b0-19eab03bce92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd" returned: 0 in 0.353s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] <== create_volume: return (1185ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672840212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f850533-583a-4293-9961-dc913139de61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:30Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Creating volume 1f850533-583a-4293-9961-dc913139de61 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:48:31 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:48:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:31 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=135, name=volume-1f850533-583a-4293-9961-dc913139de61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (aeeea296-9850-413f-9e00-f4314c9f84e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4372fa58-a2df-4daa-9b77-bcbc0074fc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a7760158-df14-4168-aa58-f72792b88124 tempest-CreateVolumesFromImageTest-75350081 None] Created volume successfully.
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4372fa58-a2df-4daa-9b77-bcbc0074fc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841640732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:31Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d2898f-4e87-4a5f-b1a7-3f7221ab9ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d2898f-4e87-4a5f-b1a7-3f7221ab9ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05983a11-7898-4545-a8dd-dea656b12955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05983a11-7898-4545-a8dd-dea656b12955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f', 'volume_name': 'volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb24c5a5-f424-4093-af37-4973922a9ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb24c5a5-f424-4093-af37-4973922a9ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2e1ffe-0065-4a59-9f0c-99ce37851169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:32 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Volume 28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f', 'volume_size': 1}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82cc25e-f10e-4ad9-b901-60bacf0e78e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63080ff-ab0e-446b-9268-8276748c9970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61 1073741824" returned: 0 in 0.625s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:32 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Volume volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd (8f08e96e-36b3-48fc-9dbe-859fb43a8afd): created successfully
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63080ff-ab0e-446b-9268-8276748c9970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (81c6cbc3-00de-4a11-8587-8388f523b01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61" returned: 0 in 0.341s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] <== create_volume: return (990ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440670941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e48392-40d3-4bf2-8492-6541b825c2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:30Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Creating volume a8e48392-40d3-4bf2-8492-6541b825c2f1 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:48:32 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:48:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-852b90dc-b156-49c4-8bf4-9e6d02e3c7d3 tempest-CreateVolumesFromImageTest-75350081 None] Created volume successfully.
Sep 03 08:48:32 devstack quobyte-client[82407]: System call of process 100325 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:48:32 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=136, name=volume-a8e48392-40d3-4bf2-8492-6541b825c2f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4f835a-f56e-4f12-9bcc-508a15b20803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f850533-583a-4293-9961-dc913139de61', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64235ce-7b61-44f3-b3d4-0634fd0000b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1 1073741824" returned: 0 in 0.484s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:33 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Volume volume-1f850533-583a-4293-9961-dc913139de61 (1f850533-583a-4293-9961-dc913139de61): created successfully
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64235ce-7b61-44f3-b3d4-0634fd0000b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (4b0a82fe-a822-4e4b-9276-cc1599e9013b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1" returned: 0 in 0.307s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] <== create_volume: return (813ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841640732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f30f4f5e68347699fcae68ba749b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:31Z,use_quota=True,user_id='d78bb1b402d94a6bbe91e1c82dd43c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Creating volume 28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:48:33 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:33 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=137, name=volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e8015e9a-b638-455c-93a4-dac0246541fc tempest-CreateVolumesFromImageTest-75350081 None] Created volume successfully.
Sep 03 08:48:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073d3b58-3c8e-4a12-a20e-18956b43b7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e48392-40d3-4bf2-8492-6541b825c2f1', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9845b2-c626-46d0-b8d0-cb977f9461cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f 1073741824" returned: 0 in 0.430s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:34 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Volume volume-a8e48392-40d3-4bf2-8492-6541b825c2f1 (a8e48392-40d3-4bf2-8492-6541b825c2f1): created successfully
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9845b2-c626-46d0-b8d0-cb977f9461cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (3e8ab257-89be-4393-89bf-858c14f18031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f" returned: 0 in 0.364s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] <== create_volume: return (822ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-984a4037-d493-47b0-8fd0-b03c81e81428 tempest-CreateVolumesFromImageTest-75350081 None] Created volume successfully.
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2e1ffe-0065-4a59-9f0c-99ce37851169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf801db7-7e5e-4757-801d-45b675e0566f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:34 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Volume volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f (28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f): created successfully
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf801db7-7e5e-4757-801d-45b675e0566f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Flow 'volume_create_manager' (aeeea296-9850-413f-9e00-f4314c9f84e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-36e0b906-ec23-4d5a-a97b-f7c92c7c6809 tempest-CreateVolumesFromImageTest-75350081 None] Created volume successfully.
Sep 03 08:48:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-quobyte-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacd596f-2460-4a6d-b278-f3b5e894d40c]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f" returned: 0 in 0.407s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f" released by "delete_volume" :: held 0.665s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:36 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Created reservations ['9335f063-da22-441a-90ca-87b1cdf548e8', '3056557a-e12e-4a71-8868-6ef693c6f7e9', '92feeecd-65ed-49c4-b18c-d9bc6795a67f', '03d21aea-c29e-4ccb-9a99-216cec0f5bf7'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Deleted volume successfully.
Sep 03 08:48:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-bcf7ec7d-dc5b-4a49-9b9a-f6c24445c953 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-28bf1ba1-2d1c-4b05-bac6-cf2449e91c3f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-a8e48392-40d3-4bf2-8492-6541b825c2f1-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-a8e48392-40d3-4bf2-8492-6541b825c2f1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:38 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-quobyte-a8e48392-40d3-4bf2-8492-6541b825c2f1" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-a8e48392-40d3-4bf2-8492-6541b825c2f1" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[48acb028-fba8-4cc2-8e43-8498c9ae17a9]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1" returned: 0 in 0.402s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a8e48392-40d3-4bf2-8492-6541b825c2f1" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-a8e48392-40d3-4bf2-8492-6541b825c2f1" released by "delete_volume" :: held 0.648s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Created reservations ['a46dd823-4d21-4643-ab06-a4bb2e242491', '11506504-c2b1-4943-996f-efdc46ae6f05', 'ffab5d12-3337-4adb-b3e9-a6f51cfee5a2', '9a4952fc-416a-4c42-830d-4c9c96b50291'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.095s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:39 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Deleted volume successfully.
Sep 03 08:48:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-175848d3-396c-4b0a-a90c-de24490d8846 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-a8e48392-40d3-4bf2-8492-6541b825c2f1-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:40 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-1f850533-583a-4293-9961-dc913139de61-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:40 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-1f850533-583a-4293-9961-dc913139de61-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:40 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:40 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-quobyte-1f850533-583a-4293-9961-dc913139de61" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:40 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-1f850533-583a-4293-9961-dc913139de61" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:40 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1642f97-88cd-4164-9b5d-2a14cf14fdf3]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61" returned: 0 in 0.435s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1f850533-583a-4293-9961-dc913139de61" returned: 0 in 0.090s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-1f850533-583a-4293-9961-dc913139de61" released by "delete_volume" :: held 0.704s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Created reservations ['8a067016-231b-44b3-ae21-de7675dac218', 'db31c2ca-4aff-4576-9d6a-3426c1c94b24', '7d717ee7-243c-432f-999d-7d6530b85865', '0cb2baec-6c0c-47f0-8f54-2b3576f7e3fe'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:41 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:41 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Deleted volume successfully.
Sep 03 08:48:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-c3979f54-eddc-430b-aaf1-cf7ca2758dc2 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-1f850533-583a-4293-9961-dc913139de61-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-8f08e96e-36b3-48fc-9dbe-859fb43a8afd-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-8f08e96e-36b3-48fc-9dbe-859fb43a8afd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:42 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-quobyte-8f08e96e-36b3-48fc-9dbe-859fb43a8afd" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-8f08e96e-36b3-48fc-9dbe-859fb43a8afd" acquired by "delete_volume" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:42 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9c75da-5b57-4736-8e61-21f1c04f1ca3]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd" returned: 0 in 0.404s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8f08e96e-36b3-48fc-9dbe-859fb43a8afd" returned: 0 in 0.104s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-8f08e96e-36b3-48fc-9dbe-859fb43a8afd" released by "delete_volume" :: held 0.660s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Created reservations ['7eb4dc72-0367-4270-aa6a-7c39ffd09e69', '3908f9d6-e605-48ea-941d-44da7cc25985', 'b03fec06-8261-450f-8183-aa4805baf8bd', '9c55339b-014f-40f6-8dc2-7d1b53376174'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:44 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Deleted volume successfully.
Sep 03 08:48:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2b6b73c3-58b3-4246-8388-b154268d2b06 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-8f08e96e-36b3-48fc-9dbe-859fb43a8afd-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-4c9b1c90-5ea2-4627-9311-1748352819af-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-4c9b1c90-5ea2-4627-9311-1748352819af-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "cinder-quobyte-4c9b1c90-5ea2-4627-9311-1748352819af" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-4c9b1c90-5ea2-4627-9311-1748352819af" acquired by "delete_volume" :: waited 0.009s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6032be3b-d3d8-473d-95ac-e9bd64295dd2]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af" returned: 0 in 0.419s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-4c9b1c90-5ea2-4627-9311-1748352819af" returned: 0 in 0.104s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-quobyte-4c9b1c90-5ea2-4627-9311-1748352819af" released by "delete_volume" :: held 0.673s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Created reservations ['da12cfb0-b4ca-4292-bc3d-57c47812bc86', '8d0b220d-e665-442b-a82f-09c76cc4ab91', '018cdaa3-3152-4062-b7a8-d25acc471f1d', '1aa97239-de57-49d6-8f2d-a609be027e8a'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.088s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Deleted volume successfully.
Sep 03 08:48:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b6108aff-2a0c-4b46-a03d-2e6fe0684281 tempest-CreateVolumesFromImageTest-75350081 None] Lock "cinder-4c9b1c90-5ea2-4627-9311-1748352819af-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:48:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.127s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:48:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Flow 'volume_create_manager' (2dfc0d99-ee71-402b-bb88-5db9ded6e53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d15d94-224f-447b-a928-22ec7d5ee2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d15d94-224f-447b-a928-22ec7d5ee2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60601f2b-80e2-4575-9d20-8f49eff54178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1155f9546df640be81805b0bb99bb04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:51Z,use_quota=True,user_id='f8fa7fc80eef41d59e7b86b265452797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00bc1c1-ee05-483f-b5e3-36499bf7f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00bc1c1-ee05-483f-b5e3-36499bf7f999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc9c5ba-a2c8-4e77-ba41-7cf674097e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc9c5ba-a2c8-4e77-ba41-7cf674097e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60601f2b-80e2-4575-9d20-8f49eff54178', 'volume_name': 'volume-60601f2b-80e2-4575-9d20-8f49eff54178', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781f6b2a-7a9b-4931-b424-6b5a1aac0bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781f6b2a-7a9b-4931-b424-6b5a1aac0bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f77321f-e9de-4641-aacf-e62b121132fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:51 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Volume 60601f2b-80e2-4575-9d20-8f49eff54178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60601f2b-80e2-4575-9d20-8f49eff54178', 'volume_size': 1}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60601f2b-80e2-4575-9d20-8f49eff54178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1155f9546df640be81805b0bb99bb04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:51Z,use_quota=True,user_id='f8fa7fc80eef41d59e7b86b265452797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Creating volume 60601f2b-80e2-4575-9d20-8f49eff54178 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:48:51 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:51 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=138, name=volume-60601f2b-80e2-4575-9d20-8f49eff54178, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178 1073741824" returned: 0 in 0.447s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178" returned: 0 in 0.125s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:48:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.650s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f77321f-e9de-4641-aacf-e62b121132fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60601f2b-80e2-4575-9d20-8f49eff54178', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707178b1-f6ca-49b0-bc3c-207434544c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:52 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Volume volume-60601f2b-80e2-4575-9d20-8f49eff54178 (60601f2b-80e2-4575-9d20-8f49eff54178): created successfully
Sep 03 08:48:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707178b1-f6ca-49b0-bc3c-207434544c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:52 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Flow 'volume_create_manager' (2dfc0d99-ee71-402b-bb88-5db9ded6e53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-6caf56aa-0a7c-4e21-8de9-9c2cbdc260e4 tempest-CinderUnicodeTest-2060343267 None] Created volume successfully.
Sep 03 08:48:53 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Flow 'volume_create_manager' (fc66a615-6cc2-41c7-8517-a07e3f0ea003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1056d3-36da-4829-935a-93fb5185a873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1056d3-36da-4829-935a-93fb5185a873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-730560773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db52be0-41ed-46c1-82a1-13e8d1027940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1155f9546df640be81805b0bb99bb04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:53Z,use_quota=True,user_id='f8fa7fc80eef41d59e7b86b265452797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef42e28-436b-4232-99ae-f4ef176e1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef42e28-436b-4232-99ae-f4ef176e1353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c348e19-72fd-4da0-bd7e-ea8b10a5fccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c348e19-72fd-4da0-bd7e-ea8b10a5fccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db52be0-41ed-46c1-82a1-13e8d1027940', 'volume_name': 'volume-3db52be0-41ed-46c1-82a1-13e8d1027940', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05fa293-b641-40b5-a504-c18f9c96decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05fa293-b641-40b5-a504-c18f9c96decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92347a0d-b19a-4987-afa8-fbd49d283a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:53 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Volume 3db52be0-41ed-46c1-82a1-13e8d1027940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db52be0-41ed-46c1-82a1-13e8d1027940', 'volume_size': 1}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:48:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-730560773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db52be0-41ed-46c1-82a1-13e8d1027940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1155f9546df640be81805b0bb99bb04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:48:53Z,use_quota=True,user_id='f8fa7fc80eef41d59e7b86b265452797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Creating volume 3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:48:53 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:53 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=139, name=volume-3db52be0-41ed-46c1-82a1-13e8d1027940, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 1073741824" returned: 0 in 0.337s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940" returned: 0 in 0.090s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] <== create_volume: return (520ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.537s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92347a0d-b19a-4987-afa8-fbd49d283a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db52be0-41ed-46c1-82a1-13e8d1027940', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92403c45-fb1d-4b37-a8c3-fde3e1e382a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:48:54 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Volume volume-3db52be0-41ed-46c1-82a1-13e8d1027940 (3db52be0-41ed-46c1-82a1-13e8d1027940): created successfully
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92403c45-fb1d-4b37-a8c3-fde3e1e382a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:48:54 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Flow 'volume_create_manager' (fc66a615-6cc2-41c7-8517-a07e3f0ea003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:48:54 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-bbc74ef5-6ce9-431e-bd2f-9f1aaa908a28 tempest-CinderUnicodeTest-2060343267 None] Created volume successfully.
Sep 03 08:48:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:48:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:48:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Creating offline snapshot 7cc103e9-2f39-4723-a50c-208345517a8c of volume 3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:48:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[13600be8-6cf7-40d4-be58-da4abe269d93]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940" returned: 0 in 0.422s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:56 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=140, name=volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:48:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c 1G" returned: 0 in 0.247s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3db52be0-41ed-46c1-82a1-13e8d1027940 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] CMD "qemu-img rebase -u -b volume-3db52be0-41ed-46c1-82a1-13e8d1027940 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c" returned: 0 in 0.149s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:48:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c" returned: 0 in 0.090s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.info" returned: 0 in 0.092s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.info" returned: 0 in 0.087s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.530s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:48:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b9e55a0a-ff9d-4de7-82e1-01b27302d297 tempest-CinderUnicodeTest-2060343267 None] Create snapshot completed successfully
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "cinder-7cc103e9-2f39-4723-a50c-208345517a8c-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-7cc103e9-2f39-4723-a50c-208345517a8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:58 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "cinder-quobyte-3db52be0-41ed-46c1-82a1-13e8d1027940" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-3db52be0-41ed-46c1-82a1-13e8d1027940" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "cinder-quobyte-7cc103e9-2f39-4723-a50c-208345517a8c" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-7cc103e9-2f39-4723-a50c-208345517a8c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Deleting offline snapshot 7cc103e9-2f39-4723-a50c-208345517a8c of volume 3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] snapshot_file for this snap is: volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbaa30-56d0-499b-b292-1583ec2d5acd]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c" returned: 0 in 0.385s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3db52be0-41ed-46c1-82a1-13e8d1027940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b610bfbb-10f1-4f33-bb4e-00aa7ed74252]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:48:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940" returned: 0 in 0.387s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:59 devstack quobyte-client[82407]: System call of process 100398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c" returned: 0 in 0.280s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940.7cc103e9-2f39-4723-a50c-208345517a8c" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-7cc103e9-2f39-4723-a50c-208345517a8c" released by "_delete_snapshot" :: held 1.448s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-3db52be0-41ed-46c1-82a1-13e8d1027940" released by "delete_snapshot" :: held 1.471s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:48:59 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Created reservations ['a359a799-bae9-4937-9f41-081272c892f2', 'ad8a1ac4-6f18-433c-8603-fd68b963b462', '49ac9633-3a90-451f-b40c-f1ea6332e7b8', 'a5c9830f-9177-4c52-9df6-526ed5f3b5f0'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:49:00 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Delete snapshot completed successfully.
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d4af006e-224b-4b82-9b78-10ce7eaa6d9c tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-7cc103e9-2f39-4723-a50c-208345517a8c-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "cinder-3db52be0-41ed-46c1-82a1-13e8d1027940-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-3db52be0-41ed-46c1-82a1-13e8d1027940-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:00 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "cinder-quobyte-3db52be0-41ed-46c1-82a1-13e8d1027940" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-3db52be0-41ed-46c1-82a1-13e8d1027940" acquired by "delete_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9666e196-f43a-4421-9cc3-051bdbf74679]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940" returned: 0 in 0.393s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3db52be0-41ed-46c1-82a1-13e8d1027940" returned: 0 in 0.105s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-3db52be0-41ed-46c1-82a1-13e8d1027940" released by "delete_volume" :: held 0.653s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Created reservations ['e501ebaa-a72b-4794-84f9-66f746e9282a', '04155bfc-e0b7-4a18-aa84-5b054bdf1633', '7904ed2d-1f45-41e3-af3b-7f6cf9f7fc89', '94d9824f-8e5f-46d3-b7cd-240b258295ae'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "cinder-60601f2b-80e2-4575-9d20-8f49eff54178-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.297s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:49:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-60601f2b-80e2-4575-9d20-8f49eff54178-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:01 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Deleted volume successfully.
Sep 03 08:49:02 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "cinder-quobyte-60601f2b-80e2-4575-9d20-8f49eff54178" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-baab4da5-1523-416a-8c90-7a04354c958a tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-3db52be0-41ed-46c1-82a1-13e8d1027940-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-60601f2b-80e2-4575-9d20-8f49eff54178" acquired by "delete_volume" :: waited 0.031s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae3656-6c01-4c4b-97d9-674020d44f60]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178" returned: 0 in 0.407s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-60601f2b-80e2-4575-9d20-8f49eff54178" returned: 0 in 0.091s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-quobyte-60601f2b-80e2-4575-9d20-8f49eff54178" released by "delete_volume" :: held 0.686s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Created reservations ['334fe74d-2c31-4eb4-8d3e-349efd0032de', 'fc33b931-ce88-451c-ab63-403172c42e85', '4b67d52f-62d5-4d09-a46a-b56d7a52263e', '25fb6c4f-0ce9-4027-99fd-bf55e5e69f4f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.082s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:49:03 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Deleted volume successfully.
Sep 03 08:49:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d3543638-3ecd-498a-b9e0-0598304ff7a4 tempest-CinderUnicodeTest-2060343267 None] Lock "cinder-60601f2b-80e2-4575-9d20-8f49eff54178-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:13 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=44,cinder:UPDATE=69,cinder:DELETE=6,cinder:INSERT=20 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:49:13 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=85,cinder:SELECT=53,cinder:DELETE=9,cinder:INSERT=12 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:49:28 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Flow 'volume_create_manager' (241f305b-8bc4-44ab-938d-4ba7e79bd73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dedf926c-c292-4e5b-9e7a-58ad8965bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dedf926c-c292-4e5b-9e7a-58ad8965bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110480119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be2c003-eae8-4bc2-94e0-c0be81688019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ed52e4c22546e383a21b8078965cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:49:28Z,use_quota=True,user_id='3f6346f1fd944356a3ceae8358666c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5069c0-a707-49ff-b9a0-6c438fc959ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5069c0-a707-49ff-b9a0-6c438fc959ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d1d9d7-5688-4f16-a0cc-4cc4d76b6862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d1d9d7-5688-4f16-a0cc-4cc4d76b6862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be2c003-eae8-4bc2-94e0-c0be81688019', 'volume_name': 'volume-2be2c003-eae8-4bc2-94e0-c0be81688019', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d549503-d58f-4046-a9e7-d2b74c32df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d549503-d58f-4046-a9e7-d2b74c32df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b59506-9c6f-47a4-aeb3-5d99d5906d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:28 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Volume 2be2c003-eae8-4bc2-94e0-c0be81688019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be2c003-eae8-4bc2-94e0-c0be81688019', 'volume_size': 1}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110480119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be2c003-eae8-4bc2-94e0-c0be81688019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ed52e4c22546e383a21b8078965cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:49:28Z,use_quota=True,user_id='3f6346f1fd944356a3ceae8358666c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Creating volume 2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:49:28 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:49:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:28 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=142, name=volume-2be2c003-eae8-4bc2-94e0-c0be81688019, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 1073741824" returned: 0 in 0.367s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019" returned: 0 in 0.086s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] <== create_volume: return (515ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b59506-9c6f-47a4-aeb3-5d99d5906d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be2c003-eae8-4bc2-94e0-c0be81688019', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e8bdc9-f71c-49cb-869f-275e605e2b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:29 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Volume volume-2be2c003-eae8-4bc2-94e0-c0be81688019 (2be2c003-eae8-4bc2-94e0-c0be81688019): created successfully
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e8bdc9-f71c-49cb-869f-275e605e2b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:29 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Flow 'volume_create_manager' (241f305b-8bc4-44ab-938d-4ba7e79bd73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:49:29 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3935c0a6-96db-42f2-b631-44c543ab1792 tempest-SnapshotDependencyTests-1275877645 None] Created volume successfully.
Sep 03 08:49:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Creating offline snapshot 8fd45d58-7826-446d-bd07-78f5e6241c62 of volume 2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:49:30 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab454da-8423-4498-a223-8c0b47f49317]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019" returned: 0 in 0.387s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:31 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=143, name=volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 1G" returned: 0 in 0.237s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2be2c003-eae8-4bc2-94e0-c0be81688019 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] CMD "qemu-img rebase -u -b volume-2be2c003-eae8-4bc2-94e0-c0be81688019 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62" returned: 0 in 0.126s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62" returned: 0 in 0.088s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:49:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62" returned: 0 in 0.109s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.info" returned: 0 in 0.089s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:49:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.info" returned: 0 in 0.125s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.496s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:32 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3bbbb5d2-41c0-459b-8f2c-06e4f57d845d tempest-SnapshotDependencyTests-1275877645 None] Create snapshot completed successfully
Sep 03 08:49:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Flow 'volume_create_manager' (0b94d39c-3878-4138-9e29-7c69b3565877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff84f4cf-8e10-43bc-ac3b-519ad273dd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff84f4cf-8e10-43bc-ac3b-519ad273dd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7090700e-3989-46b0-8146-49f1adb0cf4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ed52e4c22546e383a21b8078965cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fd45d58-7826-446d-bd07-78f5e6241c62,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:49:33Z,use_quota=True,user_id='3f6346f1fd944356a3ceae8358666c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3906612e-0fa2-4778-bb2d-4d2f635d6f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3906612e-0fa2-4778-bb2d-4d2f635d6f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f059fd3-fe6f-4bfe-8184-f52ca8fe19fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f059fd3-fe6f-4bfe-8184-f52ca8fe19fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7090700e-3989-46b0-8146-49f1adb0cf4d', 'volume_name': 'volume-7090700e-3989-46b0-8146-49f1adb0cf4d', 'volume_size': 1, 'snapshot_id': '8fd45d58-7826-446d-bd07-78f5e6241c62'}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a94fc7e-9ffd-4a47-bc7d-ebb7ae3380fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a94fc7e-9ffd-4a47-bc7d-ebb7ae3380fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12c278e-a171-462a-a666-571b4e208875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:33 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Volume 7090700e-3989-46b0-8146-49f1adb0cf4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7090700e-3989-46b0-8146-49f1adb0cf4d', 'volume_size': 1, 'snapshot_id': '8fd45d58-7826-446d-bd07-78f5e6241c62'}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-quobyte-8fd45d58-7826-446d-bd07-78f5e6241c62-7090700e-3989-46b0-8146-49f1adb0cf4d" by "_create_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-8fd45d58-7826-446d-bd07-78f5e6241c62-7090700e-3989-46b0-8146-49f1adb0cf4d" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Creating volume 7090700e-3989-46b0-8146-49f1adb0cf4d from snapshot 8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-quobyte-7090700e-3989-46b0-8146-49f1adb0cf4d" by "_copy_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-7090700e-3989-46b0-8146-49f1adb0cf4d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] snapshot: 8fd45d58-7826-446d-bd07-78f5e6241c62, volume: 7090700e-3989-46b0-8146-49f1adb0cf4d,  {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1526160-4956-4667-ae23-6402321809d8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62" returned: 0 in 0.413s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2be2c003-eae8-4bc2-94e0-c0be81688019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Creating direct copy from snapshot {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f73d33-80d4-43c3-80ad-b6c41f1f4791]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019" returned: 0 in 0.427s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG cinder.utils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d not found in is_blk_device check {{(pid=82397) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 03 08:49:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:34 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=145, name=volume-7090700e-3989-46b0-8146-49f1adb0cf4d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:49:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d" returned: 0 in 6.517s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:41 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0de296-dad6-4eca-bc19-92d54d1cbf66]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019" returned: 0 in 0.571s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:41 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:49:41 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Converted 1024.00 MB image at 156.58 MB/s
Sep 03 08:49:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:49:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d" returned: 0 in 0.102s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-7090700e-3989-46b0-8146-49f1adb0cf4d" released by "_copy_volume_from_snapshot" :: held 8.365s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-8fd45d58-7826-446d-bd07-78f5e6241c62-7090700e-3989-46b0-8146-49f1adb0cf4d" released by "_create_volume_from_snapshot" :: held 8.396s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.414s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12c278e-a171-462a-a666-571b4e208875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7090700e-3989-46b0-8146-49f1adb0cf4d', 'volume_size': 1, 'snapshot_id': '8fd45d58-7826-446d-bd07-78f5e6241c62'}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a08b538-cdd4-44d9-add0-01284081da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:49:42 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Volume volume-7090700e-3989-46b0-8146-49f1adb0cf4d (7090700e-3989-46b0-8146-49f1adb0cf4d): created successfully
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a08b538-cdd4-44d9-add0-01284081da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:49:42 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Flow 'volume_create_manager' (0b94d39c-3878-4138-9e29-7c69b3565877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:49:42 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-23f28e1d-209c-4ba1-af13-cccee6774160 tempest-SnapshotDependencyTests-1275877645 None] Created volume successfully.
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-8fd45d58-7826-446d-bd07-78f5e6241c62-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-8fd45d58-7826-446d-bd07-78f5e6241c62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:43 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-quobyte-2be2c003-eae8-4bc2-94e0-c0be81688019" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-2be2c003-eae8-4bc2-94e0-c0be81688019" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-quobyte-8fd45d58-7826-446d-bd07-78f5e6241c62" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-8fd45d58-7826-446d-bd07-78f5e6241c62" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Deleting offline snapshot 8fd45d58-7826-446d-bd07-78f5e6241c62 of volume 2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] snapshot_file for this snap is: volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2d25d-52c6-4cd9-9f0a-a92f7623c524]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62" returned: 0 in 0.408s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2be2c003-eae8-4bc2-94e0-c0be81688019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebd2e0-aee0-484a-860d-276c43212722]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019" returned: 0 in 0.396s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62" returned: 0 in 0.202s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019.8fd45d58-7826-446d-bd07-78f5e6241c62" returned: 0 in 0.080s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-8fd45d58-7826-446d-bd07-78f5e6241c62" released by "_delete_snapshot" :: held 1.336s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-2be2c003-eae8-4bc2-94e0-c0be81688019" released by "delete_snapshot" :: held 1.386s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Created reservations ['b6694260-c759-4994-a94e-81027a331d9b', 'ac2d355d-0148-4f7b-bb8d-ae4fc9488064', 'b73bc24b-cc14-4736-a4eb-cb30c2aaa06b', '1e471e4b-6457-4524-b083-c4d1d7f7b712'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:49:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Delete snapshot completed successfully.
Sep 03 08:49:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-a23a397f-2c58-4808-8d86-f3b7f2002e8b tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-8fd45d58-7826-446d-bd07-78f5e6241c62-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-2be2c003-eae8-4bc2-94e0-c0be81688019-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-2be2c003-eae8-4bc2-94e0-c0be81688019-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-quobyte-2be2c003-eae8-4bc2-94e0-c0be81688019" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-2be2c003-eae8-4bc2-94e0-c0be81688019" acquired by "delete_volume" :: waited 0.016s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f3eee1-6ab7-4ffa-aeb6-5e383313187f]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019" returned: 0 in 0.412s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2be2c003-eae8-4bc2-94e0-c0be81688019" returned: 0 in 0.095s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-2be2c003-eae8-4bc2-94e0-c0be81688019" released by "delete_volume" :: held 0.660s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Created reservations ['50a554b3-e69b-4241-a900-2da8bfeb7b3a', '5c0e5081-4f08-456e-ab6c-eaee167f652f', 'c885f420-51f0-4609-9483-c5fff1703c84', '4ae3757c-2560-45cc-b43f-10b9d98314e9'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.117s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-7090700e-3989-46b0-8146-49f1adb0cf4d-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:46 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Deleted volume successfully.
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-7090700e-3989-46b0-8146-49f1adb0cf4d-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-cba37d3b-d73a-4b44-b45b-04da675f71b4 tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-2be2c003-eae8-4bc2-94e0-c0be81688019-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:46 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "cinder-quobyte-7090700e-3989-46b0-8146-49f1adb0cf4d" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:49:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-7090700e-3989-46b0-8146-49f1adb0cf4d" acquired by "delete_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:49:47 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d6a2a5-e98b-4209-aca1-5f81c816a412]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:49:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d" returned: 0 in 0.383s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7090700e-3989-46b0-8146-49f1adb0cf4d" returned: 0 in 0.101s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-quobyte-7090700e-3989-46b0-8146-49f1adb0cf4d" released by "delete_volume" :: held 0.652s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:47 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Created reservations ['6d25eee0-b641-4b35-89de-3b48c7b538fe', 'c234dafb-2001-448a-886b-4ed649c885ed', 'ef959883-9c85-4d32-8222-42d175eccbce', '3f1a01cc-952a-4424-b4e3-46e9a9d8f5e1'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.087s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:49:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Deleted volume successfully.
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-07e669e0-9e66-4aa9-9df6-3092554f085a tempest-SnapshotDependencyTests-1275877645 None] Lock "cinder-7090700e-3989-46b0-8146-49f1adb0cf4d-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:49:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:49:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:49:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:49:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:49:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.113s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:49:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:49:58 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=33,cinder:SELECT=20,cinder:DELETE=1,cinder:INSERT=3 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:49:58 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=19,cinder:UPDATE=20,cinder:DELETE=4,cinder:INSERT=9 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:50:20 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (0560ce8a-655e-4b96-8091-3259d755ee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d6dcc1-3fb3-4240-af7c-0f8f7e277bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d6dcc1-3fb3-4240-af7c-0f8f7e277bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107745368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:20Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c906a0-2062-438a-b8ad-c4046d8c52e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c906a0-2062-438a-b8ad-c4046d8c52e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c308d22-7a01-4feb-af91-18c27fa47e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c308d22-7a01-4feb-af91-18c27fa47e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5', 'volume_name': 'volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd78f3b-ea23-4e29-a1f9-60a243560e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd78f3b-ea23-4e29-a1f9-60a243560e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e51455-1eda-462e-9854-9f245a4b066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:20 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Volume f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5', 'volume_size': 1}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107745368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:20Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Creating volume f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:20 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:20 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=146, name=volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:20 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Flow 'volume_create_manager' (5cc7ed18-4c9d-40ed-835f-0acfadf802aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3250f4-d05d-486a-85d9-8fdb79241574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5 1073741824" returned: 0 in 0.854s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:21 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (8be7efa7-ccbb-41db-827c-eb455f31bee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1996f211-831a-4bb7-b548-1ce5312f3f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3250f4-d05d-486a-85d9-8fdb79241574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1863e368-e614-4615-8e9f-9758c4ecb52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30370e0722043289f1dc38093a95ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:20Z,use_quota=True,user_id='a095a3b4451c4449a22a8fb41f7eb8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2908e5-dcaa-41fd-a2a9-4ad860a27f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2908e5-dcaa-41fd-a2a9-4ad860a27f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe67fc-0e37-4a48-9fd5-2ad2ac2814be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe67fc-0e37-4a48-9fd5-2ad2ac2814be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1863e368-e614-4615-8e9f-9758c4ecb52f', 'volume_name': 'volume-1863e368-e614-4615-8e9f-9758c4ecb52f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926c88c5-15cd-4872-95e9-093152fe7b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926c88c5-15cd-4872-95e9-093152fe7b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6605b7-87ad-49ee-ad66-a5abc3adf44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Volume 1863e368-e614-4615-8e9f-9758c4ecb52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1863e368-e614-4615-8e9f-9758c4ecb52f', 'volume_size': 1}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:21 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (0a040744-c554-4103-88f6-58887b9289a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a211abe7-6960-4322-b21f-9383584cfa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a211abe7-6960-4322-b21f-9383584cfa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1588477147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a7626e-aa3a-4dff-b874-5dc2e95d483e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:21Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7316ea-0048-4ee9-8e22-e45dfc8eacb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7316ea-0048-4ee9-8e22-e45dfc8eacb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826bdb75-f6a6-4a6e-9260-12f167f90e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826bdb75-f6a6-4a6e-9260-12f167f90e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a7626e-aa3a-4dff-b874-5dc2e95d483e', 'volume_name': 'volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cda8d14-183a-4e18-8808-ea4daf2b536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cda8d14-183a-4e18-8808-ea4daf2b536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d012cab8-3594-42be-ba8f-bf4eee4a47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume 30a7626e-aa3a-4dff-b874-5dc2e95d483e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e', 'volume_size': 1}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1996f211-831a-4bb7-b548-1ce5312f3f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797295099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c870f564-e357-450f-b271-f4776e515602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:21Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bad2c4-c8ab-4ef2-ba40-3f605a7c4f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bad2c4-c8ab-4ef2-ba40-3f605a7c4f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c3a93-2970-476c-a948-3ab68f9b73e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c3a93-2970-476c-a948-3ab68f9b73e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c870f564-e357-450f-b271-f4776e515602', 'volume_name': 'volume-c870f564-e357-450f-b271-f4776e515602', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dda5ea8-d56b-4345-9ebd-f5855e0d2ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dda5ea8-d56b-4345-9ebd-f5855e0d2ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed381dff-180e-4ede-9210-5c7abf5ea391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:21 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Volume c870f564-e357-450f-b271-f4776e515602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c870f564-e357-450f-b271-f4776e515602', 'volume_size': 1}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5" returned: 0 in 0.792s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] <== create_volume: return (1668ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.211s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1863e368-e614-4615-8e9f-9758c4ecb52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30370e0722043289f1dc38093a95ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:20Z,use_quota=True,user_id='a095a3b4451c4449a22a8fb41f7eb8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Creating volume 1863e368-e614-4615-8e9f-9758c4ecb52f {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:21 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:22 devstack quobyte-client[82407]: System call of process 100610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:22 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=147, name=volume-1863e368-e614-4615-8e9f-9758c4ecb52f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (33de285f-3da0-436f-8096-1b46005e73b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed767c36-5c6c-4ec8-9ef8-da2dd4dd89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e51455-1eda-462e-9854-9f245a4b066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473da5de-1c6d-4d47-8637-2d61dbf17e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (b0aa774e-5b78-4649-9664-93e99bc9acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512d32e-2448-4ae7-b945-6847c3c1e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f 1073741824" returned: 0 in 0.666s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed767c36-5c6c-4ec8-9ef8-da2dd4dd89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590233185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5510575d-c257-44c5-916a-0ea43e7b45b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:21Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9745d9cb-2513-4db6-9591-f0ce24adeb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9745d9cb-2513-4db6-9591-f0ce24adeb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b747961-625b-4360-a1bc-596b6d8106b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b747961-625b-4360-a1bc-596b6d8106b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5510575d-c257-44c5-916a-0ea43e7b45b2', 'volume_name': 'volume-5510575d-c257-44c5-916a-0ea43e7b45b2', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e6c275-93e0-47da-93c9-0fc5998a83fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e6c275-93e0-47da-93c9-0fc5998a83fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b070170a-e32a-4e89-b480-3d7d483f18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Volume 5510575d-c257-44c5-916a-0ea43e7b45b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5510575d-c257-44c5-916a-0ea43e7b45b2', 'volume_size': 1}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512d32e-2448-4ae7-b945-6847c3c1e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912060784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137f3093-27c2-40e2-9dbd-eb665d8d8e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:22Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06db7afa-26f5-444e-a140-b2c8b2801963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06db7afa-26f5-444e-a140-b2c8b2801963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8b26f4-c7ac-4061-9aab-97206c3274d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8b26f4-c7ac-4061-9aab-97206c3274d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137f3093-27c2-40e2-9dbd-eb665d8d8e90', 'volume_name': 'volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0823e5ad-ae70-41a5-8408-b11051db2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0823e5ad-ae70-41a5-8408-b11051db2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81f1518-c49d-46e8-9f14-4b503e65b6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Volume 137f3093-27c2-40e2-9dbd-eb665d8d8e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90', 'volume_size': 1}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Volume volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5 (f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5): created successfully
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473da5de-1c6d-4d47-8637-2d61dbf17e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (0560ce8a-655e-4b96-8091-3259d755ee46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f" returned: 0 in 0.392s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] <== create_volume: return (1122ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1588477147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a7626e-aa3a-4dff-b874-5dc2e95d483e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:21Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Creating volume 30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:23 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:23 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=148, name=volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:23 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b5a3cf6b-3fd1-40d9-89f3-e7cb3cb7f417 tempest-CreateVolumesFromImageTest-1152461205 None] Created volume successfully.
Sep 03 08:50:23 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (82f85d06-8408-4a4a-aeda-ad214af42fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef354a3-dce7-40c2-871b-7adf4ab6f8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6605b7-87ad-49ee-ad66-a5abc3adf44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1863e368-e614-4615-8e9f-9758c4ecb52f', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9142582c-c1c8-48cd-b57c-80ae4fa9d324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e 1073741824" returned: 0 in 0.563s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef354a3-dce7-40c2-871b-7adf4ab6f8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568291737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7677d372-4c0e-466d-9374-f515585ce355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:22Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da5a3a7-d0c5-4e9b-ad49-e227e07c49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da5a3a7-d0c5-4e9b-ad49-e227e07c49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ddbeec-2980-4ef8-a088-70d4b6eb8396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ddbeec-2980-4ef8-a088-70d4b6eb8396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7677d372-4c0e-466d-9374-f515585ce355', 'volume_name': 'volume-7677d372-4c0e-466d-9374-f515585ce355', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e71532-b012-448e-9104-49d4373ec6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e71532-b012-448e-9104-49d4373ec6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceb1f0a-d1df-4824-8ffb-01425cbed25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Volume 7677d372-4c0e-466d-9374-f515585ce355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7677d372-4c0e-466d-9374-f515585ce355', 'volume_size': 1}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Volume volume-1863e368-e614-4615-8e9f-9758c4ecb52f (1863e368-e614-4615-8e9f-9758c4ecb52f): created successfully
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9142582c-c1c8-48cd-b57c-80ae4fa9d324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Flow 'volume_create_manager' (5cc7ed18-4c9d-40ed-835f-0acfadf802aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e" returned: 0 in 0.340s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] <== create_volume: return (973ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797295099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c870f564-e357-450f-b271-f4776e515602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:21Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Creating volume c870f564-e357-450f-b271-f4776e515602 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:24 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:24 devstack quobyte-client[82407]: System call of process 100618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:24 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=149, name=volume-c870f564-e357-450f-b271-f4776e515602, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d012cab8-3594-42be-ba8f-bf4eee4a47ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881d9535-680c-4ea7-b8d0-6af1d99c9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2599660f-9230-4b3c-81c6-b97746bc2edc tempest-CinderUnicodeTest-463455150 None] Created volume successfully.
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602 1073741824" returned: 0 in 0.407s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e (30a7626e-aa3a-4dff-b874-5dc2e95d483e): created successfully
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881d9535-680c-4ea7-b8d0-6af1d99c9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (0a040744-c554-4103-88f6-58887b9289a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602" returned: 0 in 0.345s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590233185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5510575d-c257-44c5-916a-0ea43e7b45b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:21Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Creating volume 5510575d-c257-44c5-916a-0ea43e7b45b2 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:24 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=150, name=volume-5510575d-c257-44c5-916a-0ea43e7b45b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed381dff-180e-4ede-9210-5c7abf5ea391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c870f564-e357-450f-b271-f4776e515602', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebff8e2-86dc-4281-9686-400a1fe8f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-525ff4c8-66d5-45e1-ae83-a1571c2d1cc9 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created volume successfully.
Sep 03 08:50:25 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Volume volume-c870f564-e357-450f-b271-f4776e515602 (c870f564-e357-450f-b271-f4776e515602): created successfully
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebff8e2-86dc-4281-9686-400a1fe8f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (8be7efa7-ccbb-41db-827c-eb455f31bee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2 1073741824" returned: 0 in 0.490s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d1e64493-b2d1-4480-aa4f-d57e2662d4bd tempest-CreateVolumesFromImageTest-1152461205 None] Created volume successfully.
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2" returned: 0 in 0.491s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] <== create_volume: return (1006ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912060784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137f3093-27c2-40e2-9dbd-eb665d8d8e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:22Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Creating volume 137f3093-27c2-40e2-9dbd-eb665d8d8e90 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:25 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:26 devstack quobyte-client[82407]: System call of process 100627 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:26 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=151, name=volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:26 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Flow 'volume_create_manager' (9aeb4989-eebd-4a7f-8e52-e81bcf2e7077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db4baae-2fe4-4c55-82b7-3dcdfee27c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:26 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b070170a-e32a-4e89-b480-3d7d483f18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5510575d-c257-44c5-916a-0ea43e7b45b2', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292de3b3-3c01-4541-8aec-7104cfee871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90 1073741824" returned: 0 in 0.552s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db4baae-2fe4-4c55-82b7-3dcdfee27c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2106581908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b8827e-530c-448a-b7f6-2815bd52e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30370e0722043289f1dc38093a95ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:26Z,use_quota=True,user_id='a095a3b4451c4449a22a8fb41f7eb8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e6d4b-a084-4397-a832-30c508c66a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e6d4b-a084-4397-a832-30c508c66a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acf49c4-1c23-4352-b319-893af2424cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acf49c4-1c23-4352-b319-893af2424cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b8827e-530c-448a-b7f6-2815bd52e211', 'volume_name': 'volume-37b8827e-530c-448a-b7f6-2815bd52e211', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4229976-3dcd-4266-b0fe-206f78d0a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4229976-3dcd-4266-b0fe-206f78d0a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5968a7c-c876-428d-81a4-f0060880d267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:26 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Volume 37b8827e-530c-448a-b7f6-2815bd52e211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b8827e-530c-448a-b7f6-2815bd52e211', 'volume_size': 1}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90" returned: 0 in 0.342s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] <== create_volume: return (912ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.183s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1568291737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7677d372-4c0e-466d-9374-f515585ce355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0417d7428936401290dad0462421e406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:22Z,use_quota=True,user_id='39b136a13a944f9f92f504faa1b6c7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Creating volume 7677d372-4c0e-466d-9374-f515585ce355 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:26 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:27 devstack quobyte-client[82407]: System call of process 100631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:27 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=152, name=volume-7677d372-4c0e-466d-9374-f515585ce355, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:27 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Volume volume-5510575d-c257-44c5-916a-0ea43e7b45b2 (5510575d-c257-44c5-916a-0ea43e7b45b2): created successfully
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292de3b3-3c01-4541-8aec-7104cfee871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (33de285f-3da0-436f-8096-1b46005e73b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:27 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-68d0437b-c262-4ab0-b0a7-c8f32bc2f078 tempest-CreateVolumesFromImageTest-1152461205 None] Created volume successfully.
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81f1518-c49d-46e8-9f14-4b503e65b6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9088c3-95cc-42d6-90d5-63c1d2260f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:27 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Volume volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90 (137f3093-27c2-40e2-9dbd-eb665d8d8e90): created successfully
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9088c3-95cc-42d6-90d5-63c1d2260f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (b0aa774e-5b78-4649-9664-93e99bc9acd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355 1073741824" returned: 0 in 0.452s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:27 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-71e4ac08-23df-47c4-b29c-0936f4c82f7d tempest-CreateVolumesFromImageTest-1152461205 None] Created volume successfully.
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355" returned: 0 in 0.246s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] <== create_volume: return (745ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.258s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Creating offline snapshot c995095e-194d-4dd9-9673-a531c94193d1 of volume 30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceb1f0a-d1df-4824-8ffb-01425cbed25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7677d372-4c0e-466d-9374-f515585ce355', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141c6ec-7ed1-46a1-838e-b9163ecf8a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a8b0d-fe9f-4661-a328-93270d8b8784]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:28 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Volume volume-7677d372-4c0e-466d-9374-f515585ce355 (7677d372-4c0e-466d-9374-f515585ce355): created successfully
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141c6ec-7ed1-46a1-838e-b9163ecf8a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Flow 'volume_create_manager' (82f85d06-8408-4a4a-aeda-ad214af42fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-7677d372-4c0e-466d-9374-f515585ce355-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:28 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-1872a092-bbfb-4713-a8e5-0d171d38ca65 tempest-CreateVolumesFromImageTest-1152461205 None] Created volume successfully.
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-7677d372-4c0e-466d-9374-f515585ce355-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e" returned: 0 in 0.637s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:28 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=153, name=volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 1G" returned: 0 in 0.345s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img rebase -u -b volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:29 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-quobyte-7677d372-4c0e-466d-9374-f515585ce355" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img rebase -u -b volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1" returned: 0 in 0.255s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-7677d372-4c0e-466d-9374-f515585ce355" acquired by "delete_volume" :: waited 0.229s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1" returned: 0 in 0.223s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a3294b-2025-4661-af5f-b8c56f08c7f1]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1" returned: 0 in 0.191s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.info" returned: 0 in 0.149s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:50:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.info" returned: 0 in 0.192s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.427s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2106581908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b8827e-530c-448a-b7f6-2815bd52e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30370e0722043289f1dc38093a95ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:26Z,use_quota=True,user_id='a095a3b4451c4449a22a8fb41f7eb8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Creating volume 37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:30 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:30 devstack quobyte-client[82407]: System call of process 100651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:30 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=155, name=volume-37b8827e-530c-448a-b7f6-2815bd52e211, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355" returned: 0 in 1.101s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 1073741824" returned: 0 in 0.630s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-bfc06a76-aa05-4729-afed-166cda527b9b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Create snapshot completed successfully
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-7677d372-4c0e-466d-9374-f515585ce355" returned: 0 in 0.464s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-7677d372-4c0e-466d-9374-f515585ce355" released by "delete_volume" :: held 1.858s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211" returned: 0 in 0.391s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] <== create_volume: return (1080ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5968a7c-c876-428d-81a4-f0060880d267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b8827e-530c-448a-b7f6-2815bd52e211', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce36a77-1c76-494d-8db6-3a3ec9312bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Created reservations ['3f1876ae-52b8-4603-889a-ba80e28edf1a', '17e606f7-3dbb-4ed8-b473-fdde179f4f68', '280718d0-3411-48c1-b4a5-22d6c471c373', '7118a708-e67b-4ee4-8e47-3b90bc49ec0f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:31 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Volume volume-37b8827e-530c-448a-b7f6-2815bd52e211 (37b8827e-530c-448a-b7f6-2815bd52e211): created successfully
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce36a77-1c76-494d-8db6-3a3ec9312bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Flow 'volume_create_manager' (9aeb4989-eebd-4a7f-8e52-e81bcf2e7077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f38a0033-d1a5-4a85-b921-11073bdb6827 tempest-CinderUnicodeTest-463455150 None] Created volume successfully.
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.101s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:31 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-137f3093-27c2-40e2-9dbd-eb665d8d8e90-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:31 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Deleted volume successfully.
Sep 03 08:50:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-137f3093-27c2-40e2-9dbd-eb665d8d8e90-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ddb56ff5-a6c1-4ae7-985b-115a230a409a tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-7677d372-4c0e-466d-9374-f515585ce355-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:32 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-quobyte-137f3093-27c2-40e2-9dbd-eb665d8d8e90" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-137f3093-27c2-40e2-9dbd-eb665d8d8e90" acquired by "delete_volume" :: waited 0.018s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:32 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc928cce-303a-4242-aac5-e489edb61c1c]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (c748aba5-625e-4c87-8921-de46c1f4d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ab023f-7cbb-4cff-8826-8e4c07248dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ab023f-7cbb-4cff-8826-8e4c07248dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1104197198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f3db41-6868-4f15-b385-46e9d3b0750e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:33Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba76fa4f-1f97-4b2c-8472-1da90bcc45d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba76fa4f-1f97-4b2c-8472-1da90bcc45d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e428d0b9-ebcb-4968-96e3-7a85f19d91bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e428d0b9-ebcb-4968-96e3-7a85f19d91bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f3db41-6868-4f15-b385-46e9d3b0750e', 'volume_name': 'volume-81f3db41-6868-4f15-b385-46e9d3b0750e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3098184-4aaf-4678-860f-f1cac57c8f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3098184-4aaf-4678-860f-f1cac57c8f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f282ea64-6efd-4faf-b22f-6f16ecf6ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:33 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume 81f3db41-6868-4f15-b385-46e9d3b0750e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f3db41-6868-4f15-b385-46e9d3b0750e', 'volume_size': 1}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90" returned: 0 in 1.048s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Creating offline snapshot d8eaa70c-9710-46ef-a401-4cf79b6b20ab of volume 37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf03cc-2646-4275-98af-8be4a780dbc8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:33 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (2212e936-70aa-48b7-8279-afe335b72307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c7735-fc05-46e6-9a65-06bce20d729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c7735-fc05-46e6-9a65-06bce20d729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1252220284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb8d55c-6ed5-440b-873a-9ea7dffdb7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:33Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059d0648-b5d1-4d9f-9f19-128b3152e1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059d0648-b5d1-4d9f-9f19-128b3152e1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d81eac-8b69-4b0f-a406-51654e7815ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d81eac-8b69-4b0f-a406-51654e7815ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb8d55c-6ed5-440b-873a-9ea7dffdb7db', 'volume_name': 'volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd2067e-5063-4bb8-96fc-385bbdb8a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd2067e-5063-4bb8-96fc-385bbdb8a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bbd67a-643c-439d-bf27-f40e063038de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:34 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume 3cb8d55c-6ed5-440b-873a-9ea7dffdb7db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db', 'volume_size': 1}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-137f3093-27c2-40e2-9dbd-eb665d8d8e90" returned: 0 in 1.210s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211" returned: 0 in 0.914s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:34 devstack quobyte-client[82407]: System call of process 100665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-137f3093-27c2-40e2-9dbd-eb665d8d8e90" released by "delete_volume" :: held 2.552s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:34 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=156, name=volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:35 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (df7ec981-20da-4238-895a-1b82213f0cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e229ec3-7852-4bf5-a36c-c75478b54d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e229ec3-7852-4bf5-a36c-c75478b54d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1089607469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81e2347-c585-41a4-94f6-d20f49fc2663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:34Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9064378f-2109-4d70-bf1e-48480a6708f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9064378f-2109-4d70-bf1e-48480a6708f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a4b2fa-1926-421d-bf81-e69173da719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a4b2fa-1926-421d-bf81-e69173da719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81e2347-c585-41a4-94f6-d20f49fc2663', 'volume_name': 'volume-b81e2347-c585-41a4-94f6-d20f49fc2663', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2c1e69-9077-46eb-9ab3-66ae9d1a41c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2c1e69-9077-46eb-9ab3-66ae9d1a41c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdec6db-736d-46c5-926f-c4455cbddf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume b81e2347-c585-41a4-94f6-d20f49fc2663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81e2347-c585-41a4-94f6-d20f49fc2663', 'volume_size': 1}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:35 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (fdcc364d-9824-4fb1-913e-63ad3f95dccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f32de88-8079-4740-8884-421cfe000002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab 1G" returned: 0 in 0.673s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): qemu-img rebase -u -b volume-37b8827e-530c-448a-b7f6-2815bd52e211 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f32de88-8079-4740-8884-421cfe000002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656420974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2175334-2194-46f7-98f2-331ff8e0eae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:34Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713dbf32-ac59-416b-8947-0254ea4a15f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713dbf32-ac59-416b-8947-0254ea4a15f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b6dda8-8c88-4f91-88c8-f3513397fbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b6dda8-8c88-4f91-88c8-f3513397fbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2175334-2194-46f7-98f2-331ff8e0eae9', 'volume_name': 'volume-f2175334-2194-46f7-98f2-331ff8e0eae9', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0444a2a3-576c-4aef-9c6a-32391b900aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0444a2a3-576c-4aef-9c6a-32391b900aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494b8f01-db51-43a5-bd93-cd4206ac4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume f2175334-2194-46f7-98f2-331ff8e0eae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2175334-2194-46f7-98f2-331ff8e0eae9', 'volume_size': 1}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:35 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (bc2b033f-e9e0-4920-a84c-eff426358be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080c8b13-8671-4f46-9a01-c611810ed4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] CMD "qemu-img rebase -u -b volume-37b8827e-530c-448a-b7f6-2815bd52e211 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab" returned: 0 in 0.516s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:50:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080c8b13-8671-4f46-9a01-c611810ed4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561569512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397c240e-d73c-44ce-b79a-6d9587a27e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:35Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7f0b3a-69c4-403c-b46d-b1ee1bff6a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7f0b3a-69c4-403c-b46d-b1ee1bff6a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3612984a-139f-437a-a0e0-234e2fad1c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3612984a-139f-437a-a0e0-234e2fad1c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397c240e-d73c-44ce-b79a-6d9587a27e26', 'volume_name': 'volume-397c240e-d73c-44ce-b79a-6d9587a27e26', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09c44e0-1af8-4aed-afb9-e5cea45c95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09c44e0-1af8-4aed-afb9-e5cea45c95ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d520cca5-02a0-4b87-98de-865ba595120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:36 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume 397c240e-d73c-44ce-b79a-6d9587a27e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397c240e-d73c-44ce-b79a-6d9587a27e26', 'volume_size': 1}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Created reservations ['dbc7466a-a0df-4bbb-8b3f-7e99880cefa7', '52cf55d4-59cc-449a-a1ad-5e7c95e3b58a', '364fc5c3-1a99-4263-816f-bea625fc0f7e', 'b649ebb9-db9d-4d19-aa37-684b27967dea'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab" returned: 0 in 0.434s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab" returned: 0 in 0.220s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.info" returned: 0 in 0.237s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:50:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.info" returned: 0 in 0.300s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.900s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.851s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1104197198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f3db41-6868-4f15-b385-46e9d3b0750e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:33Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Creating volume 81f3db41-6868-4f15-b385-46e9d3b0750e {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:37 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:37 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=158, name=volume-81f3db41-6868-4f15-b385-46e9d3b0750e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-5510575d-c257-44c5-916a-0ea43e7b45b2-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:37 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7999509b-5470-4f8b-bcfc-a6242ead5597 tempest-CinderUnicodeTest-463455150 None] Create snapshot completed successfully
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e 1073741824" returned: 0 in 0.580s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-5510575d-c257-44c5-916a-0ea43e7b45b2-delete_volume" acquired by "delete_volume" :: waited 0.340s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "cinder-d8eaa70c-9710-46ef-a401-4cf79b6b20ab-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e" returned: 0 in 0.457s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] <== create_volume: return (1190ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.617s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.884s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1252220284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb8d55c-6ed5-440b-873a-9ea7dffdb7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:33Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Creating volume 3cb8d55c-6ed5-440b-873a-9ea7dffdb7db {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:38 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:38 devstack quobyte-client[82407]: System call of process 100681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:38 devstack quobyte-client[82407]: System call of process 100681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:38 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=159, name=volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:38 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Deleted volume successfully.
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f282ea64-6efd-4faf-b22f-6f16ecf6ec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f3db41-6868-4f15-b385-46e9d3b0750e', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995258c5-ef0c-4dc7-b3b8-d84b00ddcd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-d8eaa70c-9710-46ef-a401-4cf79b6b20ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.643s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:39 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "cinder-quobyte-37b8827e-530c-448a-b7f6-2815bd52e211" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:39 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume volume-81f3db41-6868-4f15-b385-46e9d3b0750e (81f3db41-6868-4f15-b385-46e9d3b0750e): created successfully
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995258c5-ef0c-4dc7-b3b8-d84b00ddcd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (c748aba5-625e-4c87-8921-de46c1f4d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db 1073741824" returned: 0 in 0.638s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-37b8827e-530c-448a-b7f6-2815bd52e211" acquired by "delete_snapshot" :: waited 0.228s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "cinder-quobyte-d8eaa70c-9710-46ef-a401-4cf79b6b20ab" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:39 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-quobyte-5510575d-c257-44c5-916a-0ea43e7b45b2" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b3e2e3ee-0e69-459f-b494-5f6fdbc0d677 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-137f3093-27c2-40e2-9dbd-eb665d8d8e90-delete_volume" released by "delete_volume" :: held 7.328s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:39 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-111af79b-9804-4809-8f26-bb852e309e95 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created volume successfully.
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db" returned: 0 in 0.411s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] <== create_volume: return (1082ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-5510575d-c257-44c5-916a-0ea43e7b45b2" acquired by "delete_volume" :: waited 0.178s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-d8eaa70c-9710-46ef-a401-4cf79b6b20ab" acquired by "_delete_snapshot" :: waited 0.316s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Deleting offline snapshot d8eaa70c-9710-46ef-a401-4cf79b6b20ab of volume 37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] snapshot_file for this snap is: volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.349s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1089607469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81e2347-c585-41a4-94f6-d20f49fc2663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:34Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Creating volume b81e2347-c585-41a4-94f6-d20f49fc2663 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:39 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[509596c0-3947-4bca-8c53-a65fecfb7160]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[44239ccc-3165-4422-a244-0d75d0caf195]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:39 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=160, name=volume-b81e2347-c585-41a4-94f6-d20f49fc2663, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bbd67a-643c-439d-bf27-f40e063038de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25dd652-3022-4671-a361-7ede73c38fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:40 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db (3cb8d55c-6ed5-440b-873a-9ea7dffdb7db): created successfully
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25dd652-3022-4671-a361-7ede73c38fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (2212e936-70aa-48b7-8279-afe335b72307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663 1073741824" returned: 0 in 0.999s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:40 devstack quobyte-client[82407]: System call of process 100689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663" returned: 0 in 0.261s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2" returned: 0 in 0.926s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:40 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-fef7e8c1-fb65-4664-bf45-1aaaa6820eb4 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created volume successfully.
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] <== create_volume: return (1370ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.540s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656420974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2175334-2194-46f7-98f2-331ff8e0eae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:34Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Creating volume f2175334-2194-46f7-98f2-331ff8e0eae9 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:41 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:41 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=161, name=volume-f2175334-2194-46f7-98f2-331ff8e0eae9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab" returned: 0 in 1.351s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37b8827e-530c-448a-b7f6-2815bd52e211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdec6db-736d-46c5-926f-c4455cbddf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81e2347-c585-41a4-94f6-d20f49fc2663', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174f06ed-6c7e-4852-be3d-3eaa2d61839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de6fef5-d9a7-4228-9a79-900de4f7a4ea]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-5510575d-c257-44c5-916a-0ea43e7b45b2" returned: 0 in 0.743s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:41 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume volume-b81e2347-c585-41a4-94f6-d20f49fc2663 (b81e2347-c585-41a4-94f6-d20f49fc2663): created successfully
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174f06ed-6c7e-4852-be3d-3eaa2d61839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:41 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (df7ec981-20da-4238-895a-1b82213f0cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9 1073741824" returned: 0 in 0.864s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:42 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-dd077b01-d589-4847-bd99-b97728f50fa8 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created volume successfully.
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-5510575d-c257-44c5-916a-0ea43e7b45b2" released by "delete_volume" :: held 2.833s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9" returned: 0 in 0.346s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211" returned: 0 in 0.779s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] <== create_volume: return (1259ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:42 devstack quobyte-client[82407]: System call of process 100703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.657s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561569512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397c240e-d73c-44ce-b79a-6d9587a27e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad3e9f053cb431ba8a3804699a69d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:50:35Z,use_quota=True,user_id='ab134a360fa04e12841c674c73d46530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Creating volume 397c240e-d73c-44ce-b79a-6d9587a27e26 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:50:42 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:50:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:43 devstack quobyte-client[82407]: System call of process 100706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:43 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=162, name=volume-397c240e-d73c-44ce-b79a-6d9587a27e26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494b8f01-db51-43a5-bd93-cd4206ac4f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2175334-2194-46f7-98f2-331ff8e0eae9', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e284c5de-74c1-4f73-ac36-717fe33705ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab" returned: 0 in 0.805s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26 1073741824" returned: 0 in 0.604s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:43 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume volume-f2175334-2194-46f7-98f2-331ff8e0eae9 (f2175334-2194-46f7-98f2-331ff8e0eae9): created successfully
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e284c5de-74c1-4f73-ac36-717fe33705ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (fdcc364d-9824-4fb1-913e-63ad3f95dccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211.d8eaa70c-9710-46ef-a401-4cf79b6b20ab" returned: 0 in 0.537s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-d8eaa70c-9710-46ef-a401-4cf79b6b20ab" released by "_delete_snapshot" :: held 4.411s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26" returned: 0 in 0.456s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] <== create_volume: return (1108ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-37b8827e-530c-448a-b7f6-2815bd52e211" released by "delete_snapshot" :: held 4.779s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:44 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-c9eb6359-b3f3-4ca2-a2d3-33c61c60214b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created volume successfully.
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d520cca5-02a0-4b87-98de-865ba595120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397c240e-d73c-44ce-b79a-6d9587a27e26', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f144249d-1875-4753-aca4-d1de6dc78400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Created reservations ['4b00f02f-eeaf-406a-bc66-6f5ef78f2684', 'b4fcccf5-9837-48ee-b565-4bf3d7d347d7', '3aa4b898-0b74-4417-80f5-a6e6d707c884', '114e7e4b-56b2-49b3-ad25-56df881529e1'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:44 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume volume-397c240e-d73c-44ce-b79a-6d9587a27e26 (397c240e-d73c-44ce-b79a-6d9587a27e26): created successfully
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f144249d-1875-4753-aca4-d1de6dc78400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Flow 'volume_create_manager' (bc2b033f-e9e0-4920-a84c-eff426358be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:50:44 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Created reservations ['b964b32c-c376-422c-a269-49226912cc10', 'cbf3eefe-a279-4504-91e7-a0ab6a700ac9', 'f73d4f62-bda0-4ff7-a280-b156629644bd', '0f133073-536f-48d6-886f-df4e25ee6c1a'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8982a21e-c5e1-41ad-b93e-3805daf4cde7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created volume successfully.
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.209s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Delete snapshot completed successfully.
Sep 03 08:50:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Deleted volume successfully.
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-9f5dfe0c-e365-47a8-a352-62605750c706 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-d8eaa70c-9710-46ef-a401-4cf79b6b20ab-delete_snapshot" released by "delete_snapshot" :: held 6.577s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-397c240e-d73c-44ce-b79a-6d9587a27e26-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-397c240e-d73c-44ce-b79a-6d9587a27e26-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-709c6759-d48c-4634-889c-a160117492aa tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-5510575d-c257-44c5-916a-0ea43e7b45b2-delete_volume" released by "delete_volume" :: held 7.633s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-c870f564-e357-450f-b271-f4776e515602-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-c870f564-e357-450f-b271-f4776e515602-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-397c240e-d73c-44ce-b79a-6d9587a27e26" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-quobyte-c870f564-e357-450f-b271-f4776e515602" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-397c240e-d73c-44ce-b79a-6d9587a27e26" acquired by "delete_volume" :: waited 0.024s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[183a3c04-4379-434f-baba-63d2bd70483d]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-c870f564-e357-450f-b271-f4776e515602" acquired by "delete_volume" :: waited 0.134s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:46 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[b080fd88-de4a-4016-b9b9-c87687bb0193]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "cinder-37b8827e-530c-448a-b7f6-2815bd52e211-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:46 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-37b8827e-530c-448a-b7f6-2815bd52e211-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26" returned: 0 in 0.803s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602" returned: 0 in 0.967s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-397c240e-d73c-44ce-b79a-6d9587a27e26" returned: 0 in 0.401s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:47 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "cinder-quobyte-37b8827e-530c-448a-b7f6-2815bd52e211" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-397c240e-d73c-44ce-b79a-6d9587a27e26" released by "delete_volume" :: held 1.554s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-c870f564-e357-450f-b271-f4776e515602" returned: 0 in 0.322s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-37b8827e-530c-448a-b7f6-2815bd52e211" acquired by "delete_volume" :: waited 0.167s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-c870f564-e357-450f-b271-f4776e515602" released by "delete_volume" :: held 1.581s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d16616a-18be-4403-9a4d-6d27d1eb08b8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created reservations ['fa0a46b7-ee13-467d-b156-7d92ca32be5d', 'd838441e-c551-4a2e-bc5a-af0a35676794', 'b9bb12b3-31f5-4873-b04c-e358d31cc3be', '25b4411d-4321-414e-aba6-bfa77e3453ff'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Created reservations ['6bb2b119-c3e7-49af-bafb-b18bacffaae8', '6b324516-05fe-4c2a-8124-ff8fd8c4b4f0', '672564f4-5446-46c9-a326-f1653fd32411', '05eded8f-f403-4e07-b87d-1c53ae7ea9ca'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211" returned: 0 in 0.620s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-37b8827e-530c-448a-b7f6-2815bd52e211" returned: 0 in 0.561s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-37b8827e-530c-448a-b7f6-2815bd52e211" released by "delete_volume" :: held 1.431s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:48 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.620s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-f2175334-2194-46f7-98f2-331ff8e0eae9-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:49 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Deleted volume successfully.
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.834s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-f2175334-2194-46f7-98f2-331ff8e0eae9-delete_volume" acquired by "delete_volume" :: waited 0.435s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5-delete_volume" acquired by "delete_volume" :: waited 0.410s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-640425a4-1c82-4bd7-a99f-353950f26fb7 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-397c240e-d73c-44ce-b79a-6d9587a27e26-delete_volume" released by "delete_volume" :: held 4.208s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.379s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:50 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Deleted volume successfully.
Sep 03 08:50:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-f2175334-2194-46f7-98f2-331ff8e0eae9" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:50 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "cinder-quobyte-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Created reservations ['9f2f15f4-ac9b-4133-b9ab-d6fd9f91f563', '6c0d33e5-5aed-44f1-8cf5-6ecd5f340767', 'a20c3339-1c1a-4ad2-8eb5-d2392b19f269', 'b1f9867d-2756-40cd-aa66-c67c5f0e63ad'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5" acquired by "delete_volume" :: waited 0.052s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-f2175334-2194-46f7-98f2-331ff8e0eae9" acquired by "delete_volume" :: waited 0.114s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca1b51-c3f5-4039-958b-9b0b31b6bce5]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-77adc98d-c80d-499e-b8d2-cd7d0044a0fc tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-c870f564-e357-450f-b271-f4776e515602-delete_volume" released by "delete_volume" :: held 5.010s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3943631-ad04-4a18-a2c6-85f5de99c6f7]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5" returned: 0 in 0.701s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:51 devstack quobyte-client[82407]: System call of process 100735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5" returned: 0 in 0.453s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-quobyte-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5" released by "delete_volume" :: held 1.372s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9" returned: 0 in 0.985s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "cinder-1863e368-e614-4615-8e9f-9758c4ecb52f-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f2175334-2194-46f7-98f2-331ff8e0eae9" returned: 0 in 0.779s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-1863e368-e614-4615-8e9f-9758c4ecb52f-delete_volume" acquired by "delete_volume" :: waited 0.433s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.359s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-f2175334-2194-46f7-98f2-331ff8e0eae9" released by "delete_volume" :: held 2.322s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:52 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Deleted volume successfully.
Sep 03 08:50:52 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-43a09e96-027e-488e-94bd-df60249e3ca1 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-37b8827e-530c-448a-b7f6-2815bd52e211-delete_volume" released by "delete_volume" :: held 6.403s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Created reservations ['e53c3e7b-b961-40c3-87a1-715c8269c157', 'd4df5ac6-56db-4cf5-b5da-b5bdf675d1fe', '1afb1635-bd36-41fc-8fed-a29aa3930861', '8295df42-c007-4749-a525-9b71976f9ae5'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:53 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "cinder-quobyte-1863e368-e614-4615-8e9f-9758c4ecb52f" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-1863e368-e614-4615-8e9f-9758c4ecb52f" acquired by "delete_volume" :: waited 0.040s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d53f8-6188-497c-925c-f2dde9e72cd7]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created reservations ['36351ff4-6f6b-49ad-88c7-ec401b9d46f5', 'b9b47ac3-aeb3-4a9d-aa8f-6c537ad56966', 'dca120ac-a659-4710-aff9-fc6c0e5d8d8e', '7cb03f99-a557-4e41-9fcb-6b9998954232'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f" returned: 0 in 0.724s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.374s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-b81e2347-c585-41a4-94f6-d20f49fc2663-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:54 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Deleted volume successfully.
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-1863e368-e614-4615-8e9f-9758c4ecb52f" returned: 0 in 0.686s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-b81e2347-c585-41a4-94f6-d20f49fc2663-delete_volume" acquired by "delete_volume" :: waited 0.483s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-quobyte-1863e368-e614-4615-8e9f-9758c4ecb52f" released by "delete_volume" :: held 1.691s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-648269bc-a49b-4b1c-8def-13337e354437 tempest-CreateVolumesFromImageTest-1152461205 None] Lock "cinder-f5122aa2-5588-4d1f-9d7b-fc49a0f57dd5-delete_volume" released by "delete_volume" :: held 4.960s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.527s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:54 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:54 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Deleted volume successfully.
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8eef3ad9-5bd0-4ef7-b3d1-83e007eed55e tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-f2175334-2194-46f7-98f2-331ff8e0eae9-delete_volume" released by "delete_volume" :: held 5.202s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Created reservations ['af87f3e1-4a82-427a-be6c-6425d3661753', '3b19136a-3e47-4b66-8391-790dbff00e07', 'f6144a26-5bd8-4071-b8ec-b1f19f5648bc', 'f722337e-1125-4e09-8fc3-21932a7eee0e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:55 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-b81e2347-c585-41a4-94f6-d20f49fc2663" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-b81e2347-c585-41a4-94f6-d20f49fc2663" acquired by "delete_volume" :: waited 0.041s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[213ff833-f4b6-4cda-8080-ae96b9316dcd]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:55 devstack quobyte-client[82407]: System call of process 100749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.218s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:56 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Deleted volume successfully.
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663" returned: 0 in 1.225s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-b4965894-b0c0-463f-ae3e-389b962e1307 tempest-CinderUnicodeTest-463455150 None] Lock "cinder-1863e368-e614-4615-8e9f-9758c4ecb52f-delete_volume" released by "delete_volume" :: held 3.964s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-b81e2347-c585-41a4-94f6-d20f49fc2663" returned: 0 in 0.258s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-b81e2347-c585-41a4-94f6-d20f49fc2663" released by "delete_volume" :: held 1.551s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:56 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created reservations ['d1e22b70-7ab3-486c-be37-f7f228fc9492', 'd8bf1f02-2580-42a0-8cba-d5d7f8f77046', 'cf1c140e-a213-46d4-8428-362e744a05ee', 'c64f8070-e2b3-4d10-8eab-8ec1980ddd6d'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.139s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Deleted volume successfully.
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-65b58e6b-6931-45b0-89db-2787ef9b9a7d tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-b81e2347-c585-41a4-94f6-d20f49fc2663-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:57 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:50:57 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:50:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db" acquired by "delete_volume" :: waited 0.021s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:50:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[8030ac92-96c1-4099-8176-e84055c6d9ac]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:50:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db" returned: 0 in 0.541s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db" returned: 0 in 0.134s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db" released by "delete_volume" :: held 0.927s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created reservations ['61ad194d-5918-4cce-9566-d11f1f2a4d41', '4b303471-9590-45f3-a861-32a0f2dcf5a8', 'a3a3c452-6b45-42af-821a-5b2b2515ef61', '73099476-b0a0-417e-b471-0359a151ec48'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.134s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:50:59 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Deleted volume successfully.
Sep 03 08:50:59 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-0fd4240f-46a0-49e1-b94f-b505e0bbb58b tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-3cb8d55c-6ed5-440b-873a-9ea7dffdb7db-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-81f3db41-6868-4f15-b385-46e9d3b0750e-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-81f3db41-6868-4f15-b385-46e9d3b0750e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:00 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-81f3db41-6868-4f15-b385-46e9d3b0750e" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-81f3db41-6868-4f15-b385-46e9d3b0750e" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[9def0460-b96e-4bfe-88ba-1010776af628]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:00 devstack quobyte-client[82407]: System call of process 100762 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e" returned: 0 in 0.560s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-81f3db41-6868-4f15-b385-46e9d3b0750e" returned: 0 in 0.164s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-81f3db41-6868-4f15-b385-46e9d3b0750e" released by "delete_volume" :: held 0.966s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:01 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created reservations ['5de20de8-e7ee-426b-ad2a-bcd56fed58a7', '24472b31-15a8-43fd-a217-be372a34b38c', 'cf36de61-740b-4c79-a4bf-2acd1591ec1c', '147b498e-4996-4bfa-bdb2-ac32146e7226'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.151s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:02 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Deleted volume successfully.
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-c995095e-194d-4dd9-9673-a531c94193d1-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-c995095e-194d-4dd9-9673-a531c94193d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:02 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-30a7626e-aa3a-4dff-b874-5dc2e95d483e" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-1b6066bf-ae44-474b-94fe-d720f5418b37 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-81f3db41-6868-4f15-b385-46e9d3b0750e-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-30a7626e-aa3a-4dff-b874-5dc2e95d483e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-c995095e-194d-4dd9-9673-a531c94193d1" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-c995095e-194d-4dd9-9673-a531c94193d1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Deleting offline snapshot c995095e-194d-4dd9-9673-a531c94193d1 of volume 30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] snapshot_file for this snap is: volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccfb7db-7bb2-4813-8b3f-945025f4441e]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:03 devstack quobyte-client[82407]: System call of process 100767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1" returned: 0 in 0.567s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:03 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:51:03 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d2cf80-84ce-4993-8dbb-cba69485d8e8]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e" returned: 0 in 0.506s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:04 devstack quobyte-client[82407]: System call of process 100773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1" returned: 0 in 0.248s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e.c995095e-194d-4dd9-9673-a531c94193d1" returned: 0 in 0.486s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:04 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:04 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Flow 'volume_create_manager' (a147857e-70aa-4fb1-81cf-3fdd1b86e614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecc55cd-3ed6-410b-b8f7-b6ef53405c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-c995095e-194d-4dd9-9673-a531c94193d1" released by "_delete_snapshot" :: held 2.268s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecc55cd-3ed6-410b-b8f7-b6ef53405c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478168b6-18b7-4e34-aba1-512cd0a41b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4399a0f8c245423bb46f88ac7704a279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:04Z,use_quota=True,user_id='98ac5f62cb4044b48f923448074b2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d52b01c-424f-4a06-8419-3cd19f224c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d52b01c-424f-4a06-8419-3cd19f224c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f7d914-f877-4d56-9fb2-724a5d2e8dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-30a7626e-aa3a-4dff-b874-5dc2e95d483e" released by "delete_snapshot" :: held 2.392s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created reservations ['0925e042-6dd1-4871-b2e3-b11c54a9dfa3', '52cf469a-e8d3-4369-b5f5-0525cb472a9a', 'bdc6f853-f7eb-40c6-89b6-bbb8d3934ba9', '154303eb-9328-4e19-815c-c5a88af60431'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:05 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Delete snapshot completed successfully.
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-12829d85-48b2-4ebb-94b0-912bb1e95080 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-c995095e-194d-4dd9-9673-a531c94193d1-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f7d914-f877-4d56-9fb2-724a5d2e8dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '478168b6-18b7-4e34-aba1-512cd0a41b58', 'volume_name': 'volume-478168b6-18b7-4e34-aba1-512cd0a41b58', 'volume_size': 1, 'image_id': '5ca9f666-9480-4873-94b1-d0b476828bd3', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd48b41d47d4fbf6a1edcc65923479148', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4399a0f8c245423bb46f88ac7704a279', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd78978a4e4b65bfbb976ad52e62a4bd4ba6e1531203f823b79785c1112b65e994fb06891ca4907be7e18ae30140a6f2ad5051d9e879b6fc2bdb9c2341902c8bb', 'id': '5ca9f666-9480-4873-94b1-d0b476828bd3', 'created_at': datetime.datetime(2025, 9, 3, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 51, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ca9f666-9480-4873-94b1-d0b476828bd3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5eb41de0>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9821c2-d25f-428e-ba54-b8e3a08895dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9821c2-d25f-428e-ba54-b8e3a08895dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58337ea3-da11-416b-9970-66ddde28641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:05 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Volume 478168b6-18b7-4e34-aba1-512cd0a41b58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-478168b6-18b7-4e34-aba1-512cd0a41b58', 'volume_size': 1, 'image_id': '5ca9f666-9480-4873-94b1-d0b476828bd3', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd48b41d47d4fbf6a1edcc65923479148', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4399a0f8c245423bb46f88ac7704a279', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd78978a4e4b65bfbb976ad52e62a4bd4ba6e1531203f823b79785c1112b65e994fb06891ca4907be7e18ae30140a6f2ad5051d9e879b6fc2bdb9c2341902c8bb', 'id': '5ca9f666-9480-4873-94b1-d0b476828bd3', 'created_at': datetime.datetime(2025, 9, 3, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 51, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ca9f666-9480-4873-94b1-d0b476828bd3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5eb41de0>}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Cloning 478168b6-18b7-4e34-aba1-512cd0a41b58 from image 5ca9f666-9480-4873-94b1-d0b476828bd3  at location (None, None). {{(pid=82397) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-30a7626e-aa3a-4dff-b874-5dc2e95d483e-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 03 08:51:05 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Image download 0.00 MB at 0.00 MB/s
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-30a7626e-aa3a-4dff-b874-5dc2e95d483e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:05 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "cinder-quobyte-30a7626e-aa3a-4dff-b874-5dc2e95d483e" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df08628-3235-4eeb-a5e8-c43a3ba4af43]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:05 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:06 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-30a7626e-aa3a-4dff-b874-5dc2e95d483e" acquired by "delete_volume" :: waited 0.304s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:06 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bbb766-bb11-4372-8817-99a113436678]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:06 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:06 devstack sudo[100778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD
Sep 03 08:51:06 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e" returned: 0 in 0.658s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-30a7626e-aa3a-4dff-b874-5dc2e95d483e" returned: 0 in 0.269s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-quobyte-30a7626e-aa3a-4dff-b874-5dc2e95d483e" released by "delete_volume" :: held 1.223s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Created reservations ['d20dbf2b-011d-4937-8fe8-3af3cf8e9e71', '4526d6f0-4117-4fe5-95de-5ff2ab2e14fb', '0a2af569-e56e-40a0-aae2-b00c2d94f15c', '0acc698a-02c0-435e-a35b-fe46b65ac26a'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:07 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:08 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.136s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:08 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:08 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Deleted volume successfully.
Sep 03 08:51:08 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-13eb6f0b-09b4-4d50-9b3b-8aceb35bf347 tempest-CreateVolumesFromSnapshotTest-1736024932 None] Lock "cinder-30a7626e-aa3a-4dff-b874-5dc2e95d483e-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:09 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root
Sep 03 08:51:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD" returned: 0 in 3.518s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:09 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:10 devstack sudo[100787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD
Sep 03 08:51:10 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:51:12 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root
Sep 03 08:51:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD" returned: 1 in 2.665s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:51:12 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Temporary image 5ca9f666-9480-4873-94b1-d0b476828bd3 is fetched for user 98ac5f62cb4044b48f923448074b2cfa. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 03 08:51:12 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8c730-ad6f-42db-9b47-90dcfd820a12]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:12 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:13 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD
Sep 03 08:51:13 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:51:15 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (73b3422f-dc97-4597-8e9f-bae100548842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f834c20d-8e5f-48d9-bb4a-d46bc9dbb34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f834c20d-8e5f-48d9-bb4a-d46bc9dbb34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1656277286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d426cbe-35ef-43dc-a843-2a88426c6fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:14Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b826e3e-b0a7-46cf-8223-0e0f84441dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b826e3e-b0a7-46cf-8223-0e0f84441dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc9009f-1d74-493a-b1d7-b3f79fa55170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc9009f-1d74-493a-b1d7-b3f79fa55170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d426cbe-35ef-43dc-a843-2a88426c6fd3', 'volume_name': 'volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45050a95-a89e-4bbc-b393-bcac730eb052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45050a95-a89e-4bbc-b393-bcac730eb052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf67338-41f0-4994-8f19-bf2d3e8e6386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:15 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume 2d426cbe-35ef-43dc-a843-2a88426c6fd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3', 'volume_size': 1}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1656277286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d426cbe-35ef-43dc-a843-2a88426c6fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:14Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Creating volume 2d426cbe-35ef-43dc-a843-2a88426c6fd3 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:15 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:15 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:15 devstack quobyte-client[82407]: System call of process 100829 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:15 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=163, name=volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3 1073741824" returned: 0 in 0.798s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3" returned: 0 in 0.194s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:16 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] <== create_volume: return (1111ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:16 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf67338-41f0-4994-8f19-bf2d3e8e6386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:16 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9f03a-e6da-425e-b1ca-750acce081c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:17 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3 (2d426cbe-35ef-43dc-a843-2a88426c6fd3): created successfully
Sep 03 08:51:17 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Sep 03 08:51:17 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9f03a-e6da-425e-b1ca-750acce081c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:17 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (73b3422f-dc97-4597-8e9f-bae100548842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD" returned: 0 in 4.392s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:17 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:17 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-cc1092e4-5b73-405d-b472-84ab0485db98 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created volume successfully.
Sep 03 08:51:17 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD
Sep 03 08:51:17 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 03 08:51:18 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=108,cinder:UPDATE=152,cinder:DELETE=13,cinder:INSERT=34 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:51:18 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=141,cinder:SELECT=80,cinder:DELETE=16,cinder:INSERT=27 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:51:18 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:18 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:18 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (ea5b8fc9-c513-4f78-9e4f-93b669c08f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:18 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f97ec0-fd5b-4bed-bd1d-a5fa96f1a654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f97ec0-fd5b-4bed-bd1d-a5fa96f1a654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496837741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99943b52-3e2d-476a-854a-495035096e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:18Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db2a8a-6816-49b8-bca9-fb192dce9faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db2a8a-6816-49b8-bca9-fb192dce9faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31972d0-94b3-4bbe-a92a-f8fe8cf2611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31972d0-94b3-4bbe-a92a-f8fe8cf2611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99943b52-3e2d-476a-854a-495035096e86', 'volume_name': 'volume-99943b52-3e2d-476a-854a-495035096e86', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d449b4-1ff6-4d0d-971c-0cdf8b6356cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d449b4-1ff6-4d0d-971c-0cdf8b6356cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a924f1-3db7-4383-aeed-f4c6eccd3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:19 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume 99943b52-3e2d-476a-854a-495035096e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99943b52-3e2d-476a-854a-495035096e86', 'volume_size': 1}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496837741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99943b52-3e2d-476a-854a-495035096e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:18Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Creating volume 99943b52-3e2d-476a-854a-495035096e86 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:19 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:19 devstack quobyte-client[82407]: System call of process 100836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:19 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=164, name=volume-99943b52-3e2d-476a-854a-495035096e86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86 1073741824" returned: 0 in 0.702s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:19 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86" returned: 0 in 0.466s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] <== create_volume: return (1265ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:20 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (cb9d74cf-9e76-43d4-be29-e0b5eb2fbc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416bc893-95ee-406c-acfe-9bfa1fb79e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a924f1-3db7-4383-aeed-f4c6eccd3b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99943b52-3e2d-476a-854a-495035096e86', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9983af-0b04-4516-be40-dcf376e112fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416bc893-95ee-406c-acfe-9bfa1fb79e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548431713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8392f708-506d-49b8-a4cc-19f62cfa8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:20Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5360c0-858e-41c6-99a8-efa8bb15721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5360c0-858e-41c6-99a8-efa8bb15721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0de95e1-20c3-4480-b62e-0770ee7e721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0de95e1-20c3-4480-b62e-0770ee7e721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8392f708-506d-49b8-a4cc-19f62cfa8c7c', 'volume_name': 'volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7e2218-6a1f-4cc1-97e0-832fa418f990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7e2218-6a1f-4cc1-97e0-832fa418f990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de11aa-8e90-49b8-946e-b9a95f6ca865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:20 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume 8392f708-506d-49b8-a4cc-19f62cfa8c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c', 'volume_size': 1}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548431713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8392f708-506d-49b8-a4cc-19f62cfa8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:20Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Creating volume 8392f708-506d-49b8-a4cc-19f62cfa8c7c {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:20 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:21 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:21 devstack quobyte-client[82407]: System call of process 100845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:21 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=165, name=volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:21 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Sep 03 08:51:21 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume volume-99943b52-3e2d-476a-854a-495035096e86 (99943b52-3e2d-476a-854a-495035096e86): created successfully
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9983af-0b04-4516-be40-dcf376e112fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (ea5b8fc9-c513-4f78-9e4f-93b669c08f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:21 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (d45dd1f7-a336-4c27-a0fd-d1f37cbf0323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:21 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c528a2aa-792f-491b-916b-0f974e2a83f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c528a2aa-792f-491b-916b-0f974e2a83f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432811719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85819eab-8a25-4f60-b53f-0f48e7a0b289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:21Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79fa5ac-d4a7-4022-acce-f3947a6177bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79fa5ac-d4a7-4022-acce-f3947a6177bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846db81-066e-47d5-95bd-450f8c4e2d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846db81-066e-47d5-95bd-450f8c4e2d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85819eab-8a25-4f60-b53f-0f48e7a0b289', 'volume_name': 'volume-85819eab-8a25-4f60-b53f-0f48e7a0b289', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e388ccce-9e01-4c74-9003-f87b7722a8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e388ccce-9e01-4c74-9003-f87b7722a8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b940d39f-8f53-4cc4-8294-af6a742b438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume 85819eab-8a25-4f60-b53f-0f48e7a0b289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85819eab-8a25-4f60-b53f-0f48e7a0b289', 'volume_size': 1}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD" returned: 1 in 5.022s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:51:22 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-19ebebe3-8af7-4809-96dc-731a3be0a0a9 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created volume successfully.
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c 1073741824" returned: 0 in 1.158s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (421ce3b1-14d0-4224-800a-311001625c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55678d9b-9236-40d7-a411-bc86f1da0aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55678d9b-9236-40d7-a411-bc86f1da0aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338660840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f778644f-d008-4538-8dd4-8e904c1f65f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:22Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f9ff81-0190-444c-963c-7cd2279e48cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f9ff81-0190-444c-963c-7cd2279e48cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7812ce5-c227-4b6e-9199-d49b7917259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7812ce5-c227-4b6e-9199-d49b7917259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f778644f-d008-4538-8dd4-8e904c1f65f4', 'volume_name': 'volume-f778644f-d008-4538-8dd4-8e904c1f65f4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9d12de-891d-4824-bf42-08cf302ef2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9d12de-891d-4824-bf42-08cf302ef2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e612f3f-f420-4de6-b6ad-be501bd14736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume f778644f-d008-4538-8dd4-8e904c1f65f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f778644f-d008-4538-8dd4-8e904c1f65f4', 'volume_size': 1}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c" returned: 0 in 0.736s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:22 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (2166e287-8a74-49b0-b4dd-925e1dee3958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66916ed4-64d8-4449-a968-d7335bff8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] <== create_volume: return (1946ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432811719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85819eab-8a25-4f60-b53f-0f48e7a0b289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:21Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Creating volume 85819eab-8a25-4f60-b53f-0f48e7a0b289 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:22 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:22 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:23 devstack quobyte-client[82407]: System call of process 100849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:23 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=166, name=volume-85819eab-8a25-4f60-b53f-0f48e7a0b289, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66916ed4-64d8-4449-a968-d7335bff8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555420292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf84dc0-a16e-436b-8de9-704f47c217c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:22Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5193e7c1-b513-4ed2-aac2-bd61c14f8b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5193e7c1-b513-4ed2-aac2-bd61c14f8b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12f3057-34df-463b-b067-aa7891d2a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12f3057-34df-463b-b067-aa7891d2a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf84dc0-a16e-436b-8de9-704f47c217c7', 'volume_name': 'volume-fcf84dc0-a16e-436b-8de9-704f47c217c7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b59405-da2c-44eb-a113-83f6a84a092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b59405-da2c-44eb-a113-83f6a84a092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811a13c8-5632-4f4c-ac4a-357db0a29e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume fcf84dc0-a16e-436b-8de9-704f47c217c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf84dc0-a16e-436b-8de9-704f47c217c7', 'volume_size': 1}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de11aa-8e90-49b8-946e-b9a95f6ca865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2e4573-5a68-4571-9c99-5049b7380b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289 1073741824" returned: 0 in 0.620s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:23 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c (8392f708-506d-49b8-a4cc-19f62cfa8c7c): created successfully
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2e4573-5a68-4571-9c99-5049b7380b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:23 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (cb9d74cf-9e76-43d4-be29-e0b5eb2fbc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289" returned: 0 in 0.454s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] <== create_volume: return (1104ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478168b6-18b7-4e34-aba1-512cd0a41b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4399a0f8c245423bb46f88ac7704a279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:04Z,use_quota=True,user_id='98ac5f62cb4044b48f923448074b2cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Creating volume 478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:24 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:24 devstack quobyte-client[82407]: System call of process 100853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:24 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=167, name=volume-478168b6-18b7-4e34-aba1-512cd0a41b58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:24 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-a8973da9-137e-476f-8510-7cb8ae1d91c6 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created volume successfully.
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b940d39f-8f53-4cc4-8294-af6a742b438b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85819eab-8a25-4f60-b53f-0f48e7a0b289', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfca7b7-6ed7-49ae-9ccb-4a36062f966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 1073741824" returned: 0 in 0.639s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:24 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:24 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume volume-85819eab-8a25-4f60-b53f-0f48e7a0b289 (85819eab-8a25-4f60-b53f-0f48e7a0b289): created successfully
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfca7b7-6ed7-49ae-9ccb-4a36062f966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (d45dd1f7-a336-4c27-a0fd-d1f37cbf0323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58" returned: 0 in 0.402s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] <== create_volume: return (1082ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.317s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-338660840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f778644f-d008-4538-8dd4-8e904c1f65f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:22Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Creating volume f778644f-d008-4538-8dd4-8e904c1f65f4 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:25 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:25 devstack quobyte-client[82407]: System call of process 100857 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:25 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=168, name=volume-f778644f-d008-4538-8dd4-8e904c1f65f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:25 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-3685ac3f-7af5-45e9-ab14-148ac182de58 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created volume successfully.
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Attempting download of 5ca9f666-9480-4873-94b1-d0b476828bd3 ((None, None)) to volume 478168b6-18b7-4e34-aba1-512cd0a41b58. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4 1073741824" returned: 0 in 0.582s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:25 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bdcada-9994-44d2-a9e4-3a6d0ed8d382]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ca9f666-9480-4873-94b1-d0b476828bd3_8qi2th11 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4" returned: 0 in 0.409s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.982s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555420292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf84dc0-a16e-436b-8de9-704f47c217c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929435f495c24518aa41b1e2b56aec60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:22Z,use_quota=True,user_id='71ea7e4c762c4fc1bef5e02a63bd3683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Creating volume fcf84dc0-a16e-436b-8de9-704f47c217c7 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:26 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e612f3f-f420-4de6-b6ad-be501bd14736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f778644f-d008-4538-8dd4-8e904c1f65f4', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:26 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2357125-fdc9-4acf-ae1a-543865ba1435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:26 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=169, name=volume-fcf84dc0-a16e-436b-8de9-704f47c217c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ca9f666-9480-4873-94b1-d0b476828bd3_8qi2th11" returned: 0 in 0.838s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ca9f666-9480-4873-94b1-d0b476828bd3_8qi2th11 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:27 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume volume-f778644f-d008-4538-8dd4-8e904c1f65f4 (f778644f-d008-4538-8dd4-8e904c1f65f4): created successfully
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2357125-fdc9-4acf-ae1a-543865ba1435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (421ce3b1-14d0-4224-800a-311001625c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7 1073741824" returned: 0 in 1.028s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:27 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-5ae2e264-9a04-4146-953d-5580768b557b tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created volume successfully.
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7" returned: 0 in 0.345s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ca9f666-9480-4873-94b1-d0b476828bd3_8qi2th11" returned: 1 in 0.898s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ca9f666-9480-4873-94b1-d0b476828bd3_8qi2th11' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] <== create_volume: return (1423ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:27 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c6ef8e-9f5b-49f6-8011-39d8e9814390]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811a13c8-5632-4f4c-ac4a-357db0a29e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf84dc0-a16e-436b-8de9-704f47c217c7', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4af84b1-9025-4239-9b90-565bba4ab84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:28 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume volume-fcf84dc0-a16e-436b-8de9-704f47c217c7 (fcf84dc0-a16e-436b-8de9-704f47c217c7): created successfully
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4af84b1-9025-4239-9b90-565bba4ab84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Flow 'volume_create_manager' (2166e287-8a74-49b0-b4dd-925e1dee3958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:28 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-b0e3efb7-2c4c-448f-92c1-a82a3dee0f26 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created volume successfully.
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD" returned: 0 in 0.588s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:28 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD" returned: 1 in 0.579s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] 5ca9f666-9480-4873-94b1-d0b476828bd3 was raw, converting to raw {{(pid=82397) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:29 devstack quobyte-client[82407]: System call of process 100875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:29 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=167, name=volume-478168b6-18b7-4e34-aba1-512cd0a41b58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58" returned: 0 in 0.235s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ca9f666-9480-4873-94b1-d0b476828bd3_zardg7j9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:51:29 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Converted 0.00 MB image at 0.00 MB/s
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:29 devstack quobyte-client[82407]: System call of process 100878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:29 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 1G" returned: 0 in 0.205s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-fcf84dc0-a16e-436b-8de9-704f47c217c7-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dab01f-381b-428f-9cad-41bca79afa9a]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-fcf84dc0-a16e-436b-8de9-704f47c217c7-delete_volume" acquired by "delete_volume" :: waited 0.345s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:30 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-quobyte-fcf84dc0-a16e-436b-8de9-704f47c217c7" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-fcf84dc0-a16e-436b-8de9-704f47c217c7" acquired by "delete_volume" :: waited 0.048s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bbd075-e7e6-44ac-8ac0-bca8b1df1421]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:30 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58" returned: 0 in 1.122s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7" returned: 0 in 0.706s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:31 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-fcf84dc0-a16e-436b-8de9-704f47c217c7" returned: 0 in 0.227s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-fcf84dc0-a16e-436b-8de9-704f47c217c7" released by "delete_volume" :: held 1.466s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58" returned: 1 in 1.182s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Downloaded image 5ca9f666-9480-4873-94b1-d0b476828bd3 ((None, None)) to volume 478168b6-18b7-4e34-aba1-512cd0a41b58 successfully. {{(pid=82397) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Temporary image 5ca9f666-9480-4873-94b1-d0b476828bd3 for user 98ac5f62cb4044b48f923448074b2cfa is deleted. {{(pid=82397) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.volume_utils [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Marking volume 478168b6-18b7-4e34-aba1-512cd0a41b58 as bootable. {{(pid=82397) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Copying metadata from image 5ca9f666-9480-4873-94b1-d0b476828bd3 to 478168b6-18b7-4e34-aba1-512cd0a41b58. {{(pid=82397) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Creating volume glance metadata for volume 478168b6-18b7-4e34-aba1-512cd0a41b58 backed by image 5ca9f666-9480-4873-94b1-d0b476828bd3 with: {'image_id': '5ca9f666-9480-4873-94b1-d0b476828bd3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd48b41d47d4fbf6a1edcc65923479148', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82397) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created reservations ['dc5df13c-de2a-4c1d-8a35-153114e9badd', '5eb81b36-7731-4510-ab76-737cff4c339d', '5e9a7141-ed7d-4feb-ae97-2d4c4fc46cad', '94d7dc1f-aec9-42f6-84ed-6c7daaf43c5e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58337ea3-da11-416b-9970-66ddde28641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478168b6-18b7-4e34-aba1-512cd0a41b58', 'volume_size': 1, 'image_id': '5ca9f666-9480-4873-94b1-d0b476828bd3', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd48b41d47d4fbf6a1edcc65923479148', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4399a0f8c245423bb46f88ac7704a279', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd78978a4e4b65bfbb976ad52e62a4bd4ba6e1531203f823b79785c1112b65e994fb06891ca4907be7e18ae30140a6f2ad5051d9e879b6fc2bdb9c2341902c8bb', 'id': '5ca9f666-9480-4873-94b1-d0b476828bd3', 'created_at': datetime.datetime(2025, 9, 3, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 3, 6, 51, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ca9f666-9480-4873-94b1-d0b476828bd3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5b5eb41de0>}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7d88f2-1921-4397-9170-b7a4d4b1b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:32 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:33 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Volume volume-478168b6-18b7-4e34-aba1-512cd0a41b58 (478168b6-18b7-4e34-aba1-512cd0a41b58): created successfully
Sep 03 08:51:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7d88f2-1921-4397-9170-b7a4d4b1b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:33 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Flow 'volume_create_manager' (a147857e-70aa-4fb1-81cf-3fdd1b86e614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-f778644f-d008-4538-8dd4-8e904c1f65f4-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:33 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4c891d73-ed1c-49f0-8e62-4601d48da94a tempest-VolumeImageDependencyTests-97620098 None] Created volume successfully.
Sep 03 08:51:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Acquiring lock "cinder-478168b6-18b7-4e34-aba1-512cd0a41b58-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:33 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 1.030s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:33 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:33 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-f778644f-d008-4538-8dd4-8e904c1f65f4-delete_volume" acquired by "delete_volume" :: waited 0.272s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Lock "cinder-478168b6-18b7-4e34-aba1-512cd0a41b58-delete_volume" acquired by "delete_volume" :: waited 0.250s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:34 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Deleted volume successfully.
Sep 03 08:51:34 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-quobyte-f778644f-d008-4538-8dd4-8e904c1f65f4" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ec114517-4cb1-47a2-a583-2b6edeaba573 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-fcf84dc0-a16e-436b-8de9-704f47c217c7-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:34 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Acquiring lock "cinder-quobyte-478168b6-18b7-4e34-aba1-512cd0a41b58" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-f778644f-d008-4538-8dd4-8e904c1f65f4" acquired by "delete_volume" :: waited 0.048s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Lock "cinder-quobyte-478168b6-18b7-4e34-aba1-512cd0a41b58" acquired by "delete_volume" :: waited 0.041s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[0431c6b5-d2e4-4d68-bcea-d1ed22c59213]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe75f1-36d2-4683-b931-a49cd4c4c20f]: (4, 'raw') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:34 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4" returned: 0 in 0.887s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58" returned: 0 in 0.775s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:35 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-f778644f-d008-4538-8dd4-8e904c1f65f4" returned: 0 in 0.296s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:35 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-f778644f-d008-4538-8dd4-8e904c1f65f4" released by "delete_volume" :: held 1.428s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:35 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created reservations ['e290995b-0595-4a7a-9769-c483c70b44b3', '65f2b542-8ef4-4c8b-bd5a-3a59e528400e', 'bdbd9c95-0473-4e1a-948b-74f05a97b296', '8786e08a-cbfd-4678-9afb-ae12eceaa13e'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58" returned: 1 in 0.642s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58' failed. Not Retrying. {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-478168b6-18b7-4e34-aba1-512cd0a41b58" returned: 0 in 0.521s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Lock "cinder-quobyte-478168b6-18b7-4e34-aba1-512cd0a41b58" released by "delete_volume" :: held 2.401s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:36 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Flow 'volume_create_manager' (67cdf2b6-47b5-46c0-a163-d89b781a3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349e860f-1425-4c47-b111-5c26c54a3ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349e860f-1425-4c47-b111-5c26c54a3ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1808675208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843ea8c5-e0aa-42c4-bf73-66345cd1a947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2f64f0c9384ff692df2a41f51a5ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:36Z,use_quota=True,user_id='40d6c23971144d46ac219419aa383bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3481fad7-6319-4151-9d8d-ae3b1d684d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3481fad7-6319-4151-9d8d-ae3b1d684d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c41f7c-aa0f-44eb-b00d-337678216dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c41f7c-aa0f-44eb-b00d-337678216dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843ea8c5-e0aa-42c4-bf73-66345cd1a947', 'volume_name': 'volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fca984-25ee-4d84-a3c5-eb5bf1cea25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fca984-25ee-4d84-a3c5-eb5bf1cea25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f5a507-cdeb-45ad-b088-a9a56e574939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:36 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Volume 843ea8c5-e0aa-42c4-bf73-66345cd1a947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947', 'volume_size': 1}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5b69e03e80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1808675208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843ea8c5-e0aa-42c4-bf73-66345cd1a947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2f64f0c9384ff692df2a41f51a5ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:36Z,use_quota=True,user_id='40d6c23971144d46ac219419aa383bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)}" {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Creating volume 843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:36 devstack cinder-volume[82397]: INFO cinder.volume.drivers.remotefs [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] casted to 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051
Sep 03 08:51:36 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 1073741824 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:37 devstack quobyte-client[82407]: System call of process 100903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:37 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=170, name=volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-85819eab-8a25-4f60-b53f-0f48e7a0b289-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 1073741824" returned: 0 in 0.856s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.524s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:37 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:38 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Deleted volume successfully.
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-85819eab-8a25-4f60-b53f-0f48e7a0b289-delete_volume" acquired by "delete_volume" :: waited 0.531s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947" returned: 0 in 0.423s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] <== create_volume: return (1299ms) {'provider_location': '10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'} {{(pid=82397) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Created reservations ['47c0a14d-8a35-4fe7-abb5-ed7a4047b999', '519b0549-8a43-4cdd-8534-3527c3d08787', '3d2d081c-175e-4c84-a6ff-5a95f715f89f', '833f507a-e0d3-4123-bbf9-c7872f08b8b9'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-8aa13381-3d82-4cd5-9803-0b593d9e3ae2 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-f778644f-d008-4538-8dd4-8e904c1f65f4-delete_volume" released by "delete_volume" :: held 4.277s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f5a507-cdeb-45ad-b088-a9a56e574939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947', 'volume_size': 1}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dcdf24-383f-4b24-a3b8-247d86d9cdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:38 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Volume volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 (843ea8c5-e0aa-42c4-bf73-66345cd1a947): created successfully
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dcdf24-383f-4b24-a3b8-247d86d9cdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Flow 'volume_create_manager' (67cdf2b6-47b5-46c0-a163-d89b781a3920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:38 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-quobyte-85819eab-8a25-4f60-b53f-0f48e7a0b289" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-85819eab-8a25-4f60-b53f-0f48e7a0b289" acquired by "delete_volume" :: waited 0.040s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:38 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-06f738ea-1caf-4ef8-ae7f-52ffa3c733b5 tempest-SnapshotDependencyTests-1889429827 None] Created volume successfully.
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dc3d47-33a7-424b-b7f7-630f294fb07b]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:38 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.049s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:39 devstack quobyte-client[82407]: System call of process 100908 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289" returned: 0 in 0.864s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.464s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:39 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Deleted volume successfully.
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-85819eab-8a25-4f60-b53f-0f48e7a0b289" returned: 0 in 0.402s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:39 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:39 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-85819eab-8a25-4f60-b53f-0f48e7a0b289" released by "delete_volume" :: held 1.499s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Creating offline snapshot 661f8409-2557-4388-b6bf-e985a03a75d8 of volume 843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-94ef852e-89cd-4e26-99a0-67125fd67555 tempest-VolumeImageDependencyTests-97620098 None] Lock "cinder-478168b6-18b7-4e34-aba1-512cd0a41b58-delete_volume" released by "delete_volume" :: held 6.023s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ed7f7-2ea0-4e74-ad48-9b89616c5809]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created reservations ['b4ac0e7b-b9be-4f8b-9605-109308e7f0cf', '77a1e658-8692-40d0-bdc5-8540bc769b3a', 'b3150e29-a349-4a00-a4e1-05739a8f6444', '43037f87-0f26-4cda-abfe-fb4e70ca282b'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947" returned: 0 in 0.632s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:40 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 1G {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:41 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=171, name=volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 1G" returned: 0 in 0.448s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): qemu-img rebase -u -b volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] CMD "qemu-img rebase -u -b volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 -F qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8" returned: 0 in 0.282s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8" returned: 0 in 0.241s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Setting permissions: /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 -> 1000:1000 {{(pid=82397) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 03 08:51:41 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-8392f708-506d-49b8-a4cc-19f62cfa8c7c-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8" returned: 0 in 0.532s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-8392f708-506d-49b8-a4cc-19f62cfa8c7c-delete_volume" acquired by "delete_volume" :: waited 0.464s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:42 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.info" returned: 0 in 0.608s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.info is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.info {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.info" returned: 0 in 0.484s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.649s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.847s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Deleted volume successfully.
Sep 03 08:51:43 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-35154eba-d8c8-42f0-921c-3c99b47acc8f tempest-SnapshotDependencyTests-1889429827 None] Create snapshot completed successfully
Sep 03 08:51:43 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-quobyte-8392f708-506d-49b8-a4cc-19f62cfa8c7c" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-8392f708-506d-49b8-a4cc-19f62cfa8c7c" acquired by "delete_volume" :: waited 0.076s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-4e3de4de-fedd-4b1d-8efd-2647cf8fcbbe tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-85819eab-8a25-4f60-b53f-0f48e7a0b289-delete_volume" released by "delete_volume" :: held 5.767s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[22914dc3-5fa7-4c2f-b41f-4abb3f83a1fb]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:43 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:44 devstack quobyte-client[82407]: System call of process 100927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c" returned: 0 in 0.448s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:44 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-8392f708-506d-49b8-a4cc-19f62cfa8c7c" returned: 0 in 0.104s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:44 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-8392f708-506d-49b8-a4cc-19f62cfa8c7c" released by "delete_volume" :: held 0.785s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:44 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created reservations ['4b92dc70-924d-48e0-b486-c7d2417bd5bb', '0d7b001a-e4b5-4cfa-8fb8-f930e295d77a', '28bc9339-9f3e-454e-b35e-8295cf5b50ac', 'e806628b-a69c-4006-9f95-9afc546db4f4'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.373s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.flows.manager.create_volume [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82397) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-99943b52-3e2d-476a-854a-495035096e86-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:45 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Deleted volume successfully.
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-99943b52-3e2d-476a-854a-495035096e86-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Flow 'volume_create_manager' (e59d2fe8-ebc0-4eb8-82a2-15cbb151f6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ad01e7-efe6-4645-8da4-bd18d0935547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ad01e7-efe6-4645-8da4-bd18d0935547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-03T06:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17e9ee1-4cf3-4560-8e05-6907a58aa9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2f64f0c9384ff692df2a41f51a5ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-03T06:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=661f8409-2557-4388-b6bf-e985a03a75d8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-03T06:51:45Z,use_quota=True,user_id='40d6c23971144d46ac219419aa383bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e037c2ee-bdee-41ff-8be0-fe6a53162884),volume_type_id=e037c2ee-bdee-41ff-8be0-fe6a53162884)' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d343993-fd08-4172-9ed7-3a853f0f0b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d343993-fd08-4172-9ed7-3a853f0f0b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21eee6ba-586f-4814-98c9-b70b5bca9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21eee6ba-586f-4814-98c9-b70b5bca9932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a17e9ee1-4cf3-4560-8e05-6907a58aa9b5', 'volume_name': 'volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5', 'volume_size': 1, 'snapshot_id': '661f8409-2557-4388-b6bf-e985a03a75d8'}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71a6d15-721c-47c3-8e4c-362d8bee9f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71a6d15-721c-47c3-8e4c-362d8bee9f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df18c7d5-e0b3-4ea6-b3d2-9cba6a28e871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:45 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Volume a17e9ee1-4cf3-4560-8e05-6907a58aa9b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5', 'volume_size': 1, 'snapshot_id': '661f8409-2557-4388-b6bf-e985a03a75d8'}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-ebc8371f-ad9c-490b-b86c-41c53efb0f12 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-8392f708-506d-49b8-a4cc-19f62cfa8c7c-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-quobyte-661f8409-2557-4388-b6bf-e985a03a75d8-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" by "_create_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-661f8409-2557-4388-b6bf-e985a03a75d8-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Creating volume a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 from snapshot 661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Selected 10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051 as target Quobyte volume. {{(pid=82397) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-quobyte-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" by "_copy_volume_from_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:45 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-quobyte-99943b52-3e2d-476a-854a-495035096e86" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] snapshot: 661f8409-2557-4388-b6bf-e985a03a75d8, volume: a17e9ee1-4cf3-4560-8e05-6907a58aa9b5,  {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:45 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-99943b52-3e2d-476a-854a-495035096e86" acquired by "delete_volume" :: waited 0.048s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab2b42a-05a4-48d4-bd3e-cd121506f3d7]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90a86e4-f70b-4499-ae46-c461bbd3fed0]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8" returned: 0 in 0.511s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Creating direct copy from snapshot {{(pid=82397) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[3761a7c2-4cf6-4f50-b921-4552c6ee0435]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86" returned: 0 in 0.583s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:46 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-99943b52-3e2d-476a-854a-495035096e86" returned: 0 in 0.111s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:47 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-99943b52-3e2d-476a-854a-495035096e86" released by "delete_volume" :: held 1.027s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947" returned: 0 in 0.634s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:47 devstack cinder-volume[82397]: DEBUG cinder.utils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 not found in is_blk_device check {{(pid=82397) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 03 08:51:47 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:47 devstack quobyte-client[82407]: The server volume:11244876-8419-456b-aa20-0c51b4acc1de@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=11244876-8419-456b-aa20-0c51b4acc1de, inode=173, name=volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.151), requestorAccessMask=0
Sep 03 08:51:47 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created reservations ['9e0826aa-47e9-40af-a377-0598dd3abe43', '73283cda-1571-4f3a-ba58-277b55237d59', '0a90da57-558f-4624-b757-233800c130e0', '606717ed-8c97-49df-8f18-f60f8fe53fb8'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.300s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:48 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:48 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Deleted volume successfully.
Sep 03 08:51:49 devstack cinder-volume[82397]: DEBUG oslo_service.periodic_task [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 03 08:51:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:49 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:49 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-2d426cbe-35ef-43dc-a843-2a88426c6fd3-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:50 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 1.109s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:50 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-0265dc52-6e89-4907-a252-71632e8a9fc7 None None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-14af917a-6447-4695-8583-a2f43f26ffa0 tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-99943b52-3e2d-476a-854a-495035096e86-delete_volume" released by "delete_volume" :: held 5.003s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:50 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-2d426cbe-35ef-43dc-a843-2a88426c6fd3-delete_volume" acquired by "delete_volume" :: waited 0.465s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:51 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "cinder-quobyte-2d426cbe-35ef-43dc-a843-2a88426c6fd3" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:51 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-2d426cbe-35ef-43dc-a843-2a88426c6fd3" acquired by "delete_volume" :: waited 0.026s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:51 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9bbff8-769f-4f8b-9e55-4565b3b231c1]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:51 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:53 devstack quobyte-client[82407]: System call of process 100962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3" returned: 0 in 1.509s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:53 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-2d426cbe-35ef-43dc-a843-2a88426c6fd3" returned: 0 in 0.431s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:54 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-quobyte-2d426cbe-35ef-43dc-a843-2a88426c6fd3" released by "delete_volume" :: held 2.599s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Created reservations ['6aa9d73a-4042-42f9-be36-4ae70e2df917', 'a4a5af57-386b-4dbc-9ea5-9f90d1c9e773', 'c1e045a7-6a9e-49d3-a704-fd46e2891d10', '986c108f-b1c3-4bd5-8b9c-98508c1a3a98'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" returned: 0 in 8.415s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[699ae552-847e-4590-a906-7f9b0bf2c236]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.289s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:55 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:51:56 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Deleted volume successfully.
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-2221830a-61c9-43fa-84a0-c6aa9d9f519c tempest-CreateVolumesFromSourceVolumeTest-1422925800 None] Lock "cinder-2d426cbe-35ef-43dc-a843-2a88426c6fd3-delete_volume" released by "delete_volume" :: held 5.425s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947" returned: 0 in 0.804s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG cinder.image.image_utils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 {{(pid=82397) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 03 08:51:56 devstack cinder-volume[82397]: INFO cinder.image.image_utils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Converted 1024.00 MB image at 120.94 MB/s
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] File path /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 is being set with permissions: 660 {{(pid=82397) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" returned: 0 in 0.104s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" released by "_copy_volume_from_snapshot" :: held 10.893s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-661f8409-2557-4388-b6bf-e985a03a75d8-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" released by "_create_volume_from_snapshot" :: held 10.959s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:51:56 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.995s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:51:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df18c7d5-e0b3-4ea6-b3d2-9cba6a28e871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5', 'volume_size': 1, 'snapshot_id': '661f8409-2557-4388-b6bf-e985a03a75d8'}' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a1c1aa-8130-49ab-a2ea-94ab5c76704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 03 08:51:57 devstack cinder-volume[82397]: INFO cinder.volume.flows.manager.create_volume [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Volume volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 (a17e9ee1-4cf3-4560-8e05-6907a58aa9b5): created successfully
Sep 03 08:51:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a1c1aa-8130-49ab-a2ea-94ab5c76704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82397) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 03 08:51:57 devstack cinder-volume[82397]: DEBUG cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Flow 'volume_create_manager' (e59d2fe8-ebc0-4eb8-82a2-15cbb151f6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82397) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 03 08:51:57 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-7950df71-e61d-4082-bc2a-f1120e342822 tempest-SnapshotDependencyTests-1889429827 None] Created volume successfully.
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-661f8409-2557-4388-b6bf-e985a03a75d8-delete_snapshot" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-661f8409-2557-4388-b6bf-e985a03a75d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:58 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-quobyte-843ea8c5-e0aa-42c4-bf73-66345cd1a947" by "delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-843ea8c5-e0aa-42c4-bf73-66345cd1a947" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-quobyte-661f8409-2557-4388-b6bf-e985a03a75d8" by "_delete_snapshot" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-661f8409-2557-4388-b6bf-e985a03a75d8" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Deleting offline snapshot 661f8409-2557-4388-b6bf-e985a03a75d8 of volume 843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] snapshot_file for this snap is: volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178c1cd-2cea-4a29-bd8f-0c337f2eabff]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:58 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8" returned: 0 in 0.438s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.remotefs [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82397) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad51d37-f47e-4469-9946-6fc01c26c416]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947" returned: 0 in 0.410s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:51:59 devstack quobyte-client[82407]: System call of process 100979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8" returned: 0 in 0.233s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:51:59 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:52:00 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947.661f8409-2557-4388-b6bf-e985a03a75d8" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:52:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-661f8409-2557-4388-b6bf-e985a03a75d8" released by "_delete_snapshot" :: held 1.446s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:52:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-843ea8c5-e0aa-42c4-bf73-66345cd1a947" released by "delete_snapshot" :: held 1.467s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:52:00 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Created reservations ['6d1640ea-105e-459c-b4a1-11180af1992d', 'e2aecc93-b14f-420a-b3d9-0964569911af', 'fec283b5-dec9-411f-915e-db28dba7a7c8', '15d141b0-ec77-4511-9de7-1063b0dc774f'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:52:00 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Delete snapshot completed successfully.
Sep 03 08:52:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-d6479950-1357-4a1f-ab94-8d555c372bee tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-661f8409-2557-4388-b6bf-e985a03a75d8-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:52:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-843ea8c5-e0aa-42c4-bf73-66345cd1a947-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:52:00 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-843ea8c5-e0aa-42c4-bf73-66345cd1a947-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:52:01 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-quobyte-843ea8c5-e0aa-42c4-bf73-66345cd1a947" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-843ea8c5-e0aa-42c4-bf73-66345cd1a947" acquired by "delete_volume" :: waited 0.012s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3418b7d-0fbc-4b0e-90ce-415fe1533acc]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947" returned: 0 in 0.407s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-843ea8c5-e0aa-42c4-bf73-66345cd1a947" returned: 0 in 0.110s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-843ea8c5-e0aa-42c4-bf73-66345cd1a947" released by "delete_volume" :: held 0.689s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:52:01 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Created reservations ['b270d577-1d29-410d-991c-309cc4f77b69', '788ee7da-4535-49dc-9eb8-d086f1794d74', '6180eb6c-27c0-49f2-b8aa-ac3a74e81ed9', '966b0bcd-a235-40c3-885e-47e14a137e91'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.084s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:52:02 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Deleted volume successfully.
Sep 03 08:52:02 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-f432794e-b358-4547-aec1-eb18487d2a41 tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-843ea8c5-e0aa-42c4-bf73-66345cd1a947-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5-delete_volume" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:52:03 devstack cinder-volume[82397]: WARNING cinder.volume.volume_utils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "cinder-quobyte-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" by "delete_volume" {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" acquired by "delete_volume" :: waited 0.015s {{(pid=82397) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4aa6bb-ea47-4690-a4e8-0d7e1367ae67]: (4, 'qcow2') {{(pid=83675) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" returned: 0 in 0.394s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:52:03 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] CMD "rm -f /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0/volume-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" returned: 0 in 0.096s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-quobyte-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5" released by "delete_volume" :: held 0.660s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG cinder.quota [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Created reservations ['48beddac-3f89-4cb7-893b-4be69f2b6081', '870010b4-9f24-42a3-b45c-fe1537936018', '627f946e-9acf-4182-a08b-e0bb8ce57dbd', '45e8b4f3-ba85-41b8-8ea6-c8991e2b708d'] {{(pid=82397) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051': None} {{(pid=82397) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG cinder.volume.drivers.quobyte [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Available shares ['10.10.41.181/cinder-vol-a2e81084-9f5d-48dd-86da-a82051d24051'] {{(pid=82397) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.lockutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82397) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0 {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG oslo_concurrency.processutils [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ea4c2990b14818950562e71091d83c0" returned: 0 in 0.085s {{(pid=82397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG cinder.manager [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Notifying Schedulers of capabilities ... {{(pid=82397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 03 08:52:04 devstack cinder-volume[82397]: INFO cinder.volume.manager [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Deleted volume successfully.
Sep 03 08:52:04 devstack cinder-volume[82397]: DEBUG cinder.coordination [None req-e1649c15-b7ad-425c-a587-4b11fd8d480a tempest-SnapshotDependencyTests-1889429827 None] Lock "cinder-a17e9ee1-4cf3-4560-8e05-6907a58aa9b5-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82397) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 03 08:52:14 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:SELECT=71,cinder:UPDATE=104,cinder:DELETE=7,cinder:INSERT=21 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 03 08:52:14 devstack cinder-volume[82397]: DEBUG dbcounter [-] [82397] Writing DB stats cinder:UPDATE=86,cinder:SELECT=56,cinder:DELETE=11,cinder:INSERT=27 {{(pid=82397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}